Accurately evaluating the instruction-following ability of Large Language Models (LLMs) is crucial for their practical deployment. Existing evaluation methods mainly rely on static assessment of single-pass generations, making it difficult to comprehensively measure instruction-following performance or models’ capabili...
Ya-Chao Fu, Qu-Fei Zhang, Meng-Na Zhu et al.· 2026 12th International Conf...· 0 citations
Large language models (LLMs) have rapidly advanced natural-language-to-query (Text-to-Query) capabilities, yet existing public benchmarks remain confined to single database paradigms such as Text-to-SQL or Text-to-KG. They do not capture real-world settings where relational databases, graph databases, document database...
Guo-Shen Li, Hang Zhang, Ying-Jun Liu et al.· 2026 12th International Conf...· 0 citations
Experimental results show that CMNIE remains chal?lenging, especially for relation extraction and exact matching of event?argument spans; zero-shot LLMs often identify relevant semantic units but fail to match gold span boundaries exactly.
Yan-Cen Yu, Meng-Na Zhu, Zhen-Yu Song et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.