Skip to content
Conference Open access

Semantic-Driven Knowledge Assessment: Ontologies and Large Language Models for Automatic Test Generation

Sep 2026 · Automation, Control, and Information Technology · pp. 1637-1643 · 0 citations · 46 references

Abstract

This paper proposes a semantic-driven approach to automated knowledge assessment that integrates domain ontology modeling with the capabilities of large language models (LLMs) for generating test items with controlled difficulty. The core idea is to utilize formally structured knowledge, represented as an ontology, as a structural and semantic foundation for constructing valid, consistent, and interpretable test questions. An architecture of the information technology is developed, comprising modules for ontology construction, semantic reasoning, test generation, and quality evaluation. A method for test item generation is proposed, based on templates, ontological axioms, and context-aware queries to LLMs. Evaluation criteria for test quality are defined, including semantic consistency, difficulty level, discriminative power, and alignment with learning objectives. An experimental study is conducted to validate the effectiveness of the proposed approach in comparison with traditional test generation methods. The obtained results demonstrate an improvement in the quality of test items and a reduction in the time required for their development.

Read PDF

Similar papers

Enhancing Construction Requirements Documents Analytics through Integrating Ontology and Large Language Model

The results demonstrate the feasibility of the proposed framework for producing consistent sentence-level semantic extraction from quality-related construction requirement text and demonstrate how ontology-guided fine-tuning can provide explicit semantic grounding for LLM-based information extraction.

Lian-Nian Wang, Jeongbin Hwang, Kevin Han et al. · 0 citations
Open access Sep 2026

Ontological Learning Through Topic Modeling: Identifying Conceptual Candidates for Enriching a Leadership Domain Ontology

Ontologies enable the construction of formal and reusable semantic representations of domain knowledge; however, keeping them updated in response to the dynamic evolution of concepts remains a challenge, particularly in the leadership domain, where the diversity of approaches, theories, models, and styles generates con...

Carlos Mauricio Zuluaga-Ramírez, Manuela Gómez-Suta, Manuela Idárraga-Grajales et al. · 0 citations
Conference Open access Nov 2026

LLMs4OL 2026 Overview: The 3rd Large Language Models for Ontology Learning Challenge

We present the results of the 3rd Large Language Models for Ontology Learning Challenge, held at the International Semantic Web Conference 2026, a shared task designed to evaluate the effectiveness of large language models (LLMs) for ontology learning. The challenge comprised three complementary tasks: end-to-end ontol...

Hamed Babaei Giglou, Sören Auer, Jennifer D'Souza · 7 citations · ⚡2

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.