N nondeterminism-aware evaluation for LLM-based MDE evaluation is introduced, which suggests that LLM-based MDE evaluation should treat correctness, reproducibility, and variation meaning as distinct dimensions.
Riccardo Rubei, Alessio Bucaioni, A. Di Salle· ACM/IEEE International Confe...· 0 citations
Model transformation is a core model-driven engineering (MDE) operation in which reproducibility is expected: under fixed metamodels, source model, and transformation rules, a deterministic engine should produce a stable target model. Large Language Models (LLMs) are increasingly explored for MDE tasks, but evaluations...
Riccardo Rubei, Alessio Bucaioni, A. Di Salle· Proceedings of the ACM/IEEE...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.