Skip to content
Review Open access

From Job Postings to Curriculum Feedback: An LLM-Driven Framework for Constructing Role-Stratified AI Competency Knowledge Graphs

2026 · IEEE Access · Vol 14, pp. 140015-140039 · 0 citations · 61 references
Computer Science

TL;DR

A reusable framework is developed that connects recruitment-derived competency evidence with broader AI education goals, together with a module-level validation strategy that supports transparent assessment and role-informed curriculum review.

Abstract

AI-related occupations are changing rapidly, whereas higher education curricula typically follow longer institutional revision cycles. Job postings provide timely but unstructured evidence of employer-stated competency demand. Following a design science research approach, this study develops and evaluates a modular framework that transforms AI job postings into a role-stratified competency knowledge graph for curriculum-oriented analysis. We applied the framework to 4,612 job postings from Shenzhen, China, integrating four-dimensional competency extraction, five-stage entity alignment, occupational-role classification, and graph construction. On a 461-record human-annotated reference set, the full Qwen3-Max extraction protocol achieved a precision of 0.898, recall of 0.786, and Micro-F1 of 0.838, with the highest precision and Micro-F1 among the four extraction configurations. On a common stratified review sample of 1,286 manually reviewed entity pairs, the full alignment pipeline achieved a sample-based pairwise cluster precision of 0.960, recall of 0.590, and F1 of 0.731. A separate relaxed-candidate audit found a conditional missed-merge proportion of 6.5% within the relaxed same-dimension candidate space. In a 200-record predicted-label-stratified audit, the equally weighted role-assignment precision was 94.5% (Wilson 95% CI: 90.4%–96.9%). The final graph contains 30,063 nodes and 157,858 relationships and enables descriptive role-level comparisons of employer-stated competency demand. A case analysis using a public talent-cultivation plan demonstrates how graph-derived role profiles can be compared with an existing curriculum to inform program-level review. The study contributes a reusable framework that connects recruitment-derived competency evidence with broader AI education goals, together with a module-level validation strategy that supports transparent assessment and role-informed curriculum review.

Read PDF

Similar papers

Open access Oct 2026

Automatic Skill Extraction across Job Postings, Course Learning Outcomes, and Skills Framework for the Information Age for Pre-Competency Mapping Process

Background: The increasing demand for Information Technology (IT) professionals is often not aligned with the unstructured representation of competencies across various document sources, including industry documents such as job postings and educational documents such as Course Learning Outcomes (CLOs) and the Skills Fr...

Badrus Zaman, Windarto Windarto, Rimuljo Hendradi · 0 citations
Open access Oct 2026

CASPER-O: An Occupation-Aware Knowledge-Guided Framework for Career-Aligned Course Recommendation

Occupation-aligned course recommendation requires connecting occupational requirements with relevant educational content. CASPER-O addresses this task through occupation-specific retrieval, ESCO-based queries (CASPER Query), and expert-grounded encoder adaptation (CASPER-CL). The corpus contained 11,938 occupation–cour...

Pitchayanida Khumwichai, Dussadee Praserttitipong, Sayan Unankard et al. · 0 citations
Review Open access Oct 2026

An Evidence-Based Fusion Framework for Program-Level Curriculum Evaluation in Computer Science: Standards Alignment and Cognitive Demand Across Ten Introductory Offerings

Program-level curriculum evaluation is central to quality assurance in higher education, yet remains labor-intensive when disciplinary standards must be interpreted across heterogeneous, publicly available curriculum documents. This is particularly evident in computer science, where the CS2023 framework defines 17 know...

H. Jeong · 0 citations
Review Open access Sep 2026

An AI-based framework for continuous alignment between higher education and industry skill needs

The misalignment between higher education curricula and rapidly evolving industry skill requirements is a persistent concern. This study presents CurriculumCatalyst, a prototype framework that combines natural language processing (NLP) and Retrieval-Augmented Generation (RAG) to support periodic, evidence-grounded alig...

David Sunday, Francis Jingo, Joseph Kimbugwe · 0 citations
#explainable ai Review Open access Oct 2026

A systematic review of skill-centric career guidance systems: Integrating knowledge graphs, skill decay tracking, and country-based salary sequence intelligence

The paper provides a comprehensive review of the research conducted across skill extraction, large language model (LLM)-based career guidance, knowledge graph construction, learning path recommendation, prerequisite modelling, and knowledge tracing, fairness and algorithmic bias in career AI, and country-based salary i...

S. H. Puwakgolla, W. Gunathilake, D. C. T. Disanayaka · 0 citations
Open access Sep 2026

BUILDING KNOWLEDGE GRAPHS FOR MOOC SELECTION BASED ON THE INTEGRATION OF LABOR MARKET DEMANDS AND EDUCATIONAL PROGRAMS

An integration model based on knowledge graphs and machine learning methods for analyzing relationships between educational programs, labor market requirements, and online courses (MOOCs) and has the capability to identify missing competencies and automatically recommend relevant courses for their acquisition.

K. Serikbayeva, V. Ramazanova, M. Sambetbayeva et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.