Related Work — ChE Curriculum KG / OBE Analytics
Comparison table
| Study / System | Domain | Extraction method | Validation | Output |
|---|---|---|---|---|
| CLO–PLO alignment framework (Derouich, 2025 — Discover Education) | Generic engineering (ABET/NCAAA) | None — weighted matrices from assessment items to CLOs to PLOs | Acceptance bands ([0.85, 1.15]) on alignment ratios | Numeric coverage/alignment ratios, feedback-loop indicators |
| IS-based PLO assessment model (Humanities & Social Sciences Communications) | Generic higher ed | None — KPI aggregation via course articulation matrix | Not stated | Automated PLO score aggregation (Excel-based) |
| OntoCAPE (Marquardt et al.) | ChE subject matter (process engineering) | Manual formal ontology engineering (OWL, heavyweight) | Long-term applied use in CAPE software | Domain ontology: atoms → reactions → unit ops → plant equipment → models |
| OntoKin / OntoRXN | ChE subject matter (kinetics, reaction networks) | Manual, built on OntoCAPE + OntoCompChem | SPARQL query demonstrations | Reaction-network knowledge graphs |
| KG framework for digital twins of chemical processes (Nature Chem. Eng., 2026) | ChE subject matter (process/plant models) | LLM agents + OntoCAPE reuse | Case studies (grain boundary data, model reconstruction) | KG-driven digital twin construction |
| "An Ontology for Representing Curriculum and Learning Material" (arXiv 2506.05751) | Generic / CS-flavored | Ontology built on ACM/IEEE-CS Knowledge Area → Knowledge Unit → Learning Outcome model | Not evaluated against human raters | Curriculum knowledge graph ontology (KA/KU/LO) |
| LLM-Assisted KG Completion for Curriculum Modelling (arXiv 2501.12300) | Generic, cross-institution | LLM-assisted extraction of fine-grained topics from lecture materials, collaborative with human experts | Graph quality measures (Average Degree Centrality, Modularity); lecturer evaluation of usefulness | Personalized learning-path recommendation KG |
| PALM: Panoramic Learning Map (arXiv 2507.18393) | Generic, cross-course | Learning analytics + curriculum map integration | Not fully detailed in abstract | Scalable cross-course insight dashboard |
| CyBOKClaw (arXiv 2605.24663) | Cybersecurity | Human-in-the-loop mapping of syllabus topics to CyBOK taxonomy | Human-in-the-loop judgment | Curriculum-to-body-of-knowledge alignment |
| Curriculum mapping tradition (Harden 2001 AMEE Guide; general higher-ed) | Generic, any discipline | Manual, matrix-based (I/R/M coding) | Faculty consensus | Introduce/Reinforce/Master coverage grids |
| This work (ChE Curriculum KG / OBE Dashboard) | Chemical engineering, specific programme | Hybrid rule-based (regex + 200-term taxonomy) + optional LLM (Ollama) + TF-IDF, deterministic normalization pass, CLOs + course outlines as dual input | Cohen's κ against teacher voting (target benchmark κ = 0.75) | Topic-level overlap/redundancy network, Bloom's progression across semesters, PLO coverage matrix, ChE-specific ontology (Knowledge Area / Knowledge Unit) |
Where the gap sits
None of the above combine all four of:
- Formal OBE/accreditation structure (CLO → PLO, Bloom's, Washington Accord / PEC / ABET)
- Semantic, topic-level extraction validated against human raters (κ)
- A specific engineering discipline (not generic, not CS-only)
- Programme-level analytic findings (overlap/redundancy, Bloom's progression) as the output — not personalization/recommendation, not matrix arithmetic
Sharpest unclaimed angles:
- Extraction input ablation: measuring signal loss when using CLOs-only vs. CLOs + full course outlines (Jaccard similarity, topic count deltas) — nobody has studied this explicitly.
- Human validation of automated topic extraction: existing curriculum-KG papers validate graph structure (modularity, centrality), not agreement with human raters; existing CLO-PLO papers don't extract topics at all. The κ=0.75 benchmark against teacher voting is unclaimed.
- Redundancy/overlap as a derived finding: existing OBE tools only answer "is coverage numerically balanced." Nobody visualizes or quantifies where content actually repeats across courses, or how cognitive demand (Bloom's) shifts semester-to-semester as an emergent, visualized result rather than a manually-tagged cell.
To-Do: Ontology / Domain-Model Papers to Read Properly
Read these specifically for their class/module structure — useful for grounding or contrasting against the Knowledge Area / Knowledge Unit hierarchy in the ChE Ontology view.
Notes while reading (fill in during office review)
- OntoCAPE scope vs. your scope — where does subject-matter ontology end and curriculum-topic ontology begin? Is there a clean line, or should ChE Ontology view eventually link to OntoCAPE classes rather than reinvent them?
- Does arXiv 2506.05751's KA/KU/LO ontology have a public schema/OWL file worth structurally comparing against
data.json? - Check if any of these papers report inter-rater agreement numbers at all (for comparison against κ=0.75 benchmark) — note here if found: ___