Book
Open access
Jul 2026
How much does an LLM know about my programming language?
This paper introduces a systematic framework to identify and quantify the syntactic knowledge exhibited by an LLM with respect to a given programming language, and defines syntactic coverage as a set of measurable indicators of how comprehensively language constructs are represented in datasets and generated code.
David Delgado, Lola Burgueño, R. Clarisó
· Software Language Engineerin... · 0 citations