This volume collects the contributions to the 3rd LLMs4OL Challenge, Large Language Models for Ontology Learning, held at the 25th International Semantic Web Conference (ISWC 2026).
The LLMs4OL initiative began with a narrow question: can large language models perform the individual operations that ontology learning ta...
Hamed Babaei Giglou, Sören Auer, Jennifer D'Souza· Open Conference Proceedings· 3 citations
We present the results of the 3rd Large Language Models for Ontology Learning Challenge, held at the International Semantic Web Conference 2026, a shared task designed to evaluate the effectiveness of large language models (LLMs) for ontology learning. The challenge comprised three complementary tasks: end-to-end ontol...
Hamed Babaei Giglou, Sören Auer, Jennifer D'Souza· Open Conference Proceedings· 7 citations· ⚡2
A schema-grounded, tiered evaluation framework for structured scientific evidence extraction that increases task difficulty from single-entity identification to relational tuples and corpus-level statistical tasks and provides a reusable query suite and diagnostic evaluation framework to support future fine-grained ben...
Zhiyin Tan, Jennifer D'Souza, Sören Auer· International Journal on Dig...· 0 citations
Atomic layer deposition (ALD) and atomic layer etching (ALE) are reported heterogeneously across experimental and simulation literature in materials science, hindering comparison and machine-actionable reuse. We present four domain-expert-reviewed JSON Schemas for ALD and ALE experimental and simulation processes. Cura...
Sameer Sadruddin, Eleni Poupaki, Alex Watkins et al.· 0 citations
AVA is introduced, a systematic framework for evaluating whether embeddings distinguish logic-sensitive relational semantics in ontologies and knowledge graphs, and reveals a persistent gap between linguistic representation learning and ontology-level discrimination, challenging the assumption that strong NLP benchmark...
Hamed Babaei Giglou, Jennifer D'Souza, S. Auer· 0 citations
It is revealed that ensemble composition directly affects the precision-recall trade-off: heterogeneous cross-paradigm ensembles generally improve precision, whereas homogeneous LLM ensembles more often achieve higher overall F1-scores.
Hamed Babaei Giglou, S. Auer, P. Popov et al.· 0 citations
Findings show that model size alone is an insufficient selection criterion for OL and provide empirical guidance for reproducible LLM-assisted ontology engineering and indicate that architecture and model lineage can outweigh nominal parameter count.
Hamed Babaei Giglou, S. Auer, Jennifer D'Souza· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.