A framework of formal operations for assembling context in LLM-based engineering design and a formal method for evaluating modelling-as-code LLM outputs enables the evaluation of compliance to intent from LLM answers and thereby asses the support from LLMs for systems architecture modelling.
Abstract
The development of generative artificial intelligence resources enables opportunities of speeding up systems and engineering design work. This contribution introduces a framework of formal operations for assembling context in LLM-based engineering design. This framework involves the assembly of modular context units, including policy prompts, reference units with persistence, and user questions with prompt vectoring. This approach enables the systematic structuring of interactions with generative models. A formal method for evaluating modelling-as-code LLM outputs is also presented, which enables the evaluation of compliance to intent from LLM answers and thereby asses the support from LLMs for systems architecture modelling.
An initial characterization of LLM-supported design in self-adaptive systems in SASS is contributed, research directions are outlined, and discussion within the community on advancing LLM-supported architectural design for self-adaptive and autonomous software systems is stimulated.
Nadeem Abbas, Nazia Shahzadi· WiPiEC Journal - Works in Pr...· 0 citations
By moving from isolated instruction crafting to system-level contextual orchestration, context engineering reframes how large language model (LLM) applications are designed for complex, multi-source workflows. Prompt engineering can deliver strong results for narrow, single-turn tasks, yet it often becomes brittle and...
Attila Kovari· Discover Artificial Intellig...· 0 citations
The integration of Large Language Models (LLMs) into software development workflows has fundamentally transformed how developers interact with knowledge repositories, codebases, and documentation. However, traditional knowledge retrieval mechanisms face significant challenges when applied to the dynamic, multi-modal, a...
Norbert Fijałek, Ilona Bluemke, Piotr Gawrysiak· WiPiEC Journal - Works in Pr...· 0 citations
A Systematic Literature Review of 96 peer-reviewed studies on the use of LLMs in MDE is presented, aiming to consolidate existing knowledge, highlight emerging patterns, and identify key limitations and research opportunities for future advancement.
Arianna Fedeli, Maria Teresa Rossi, Ludovico Iovino· Proceedings of the ACM/IEEE...· 1 citation
The Common Requirement Modeling Language (CRML) is a domain-specific controled natural language intended to capture requirements in a format that is readable by multidisciplinary stakeholders. However, similarly to other domain-specific languages, CRML suffers from limited available human expertise and material. LLMs p...
Máté Földiák, L. Buffoni, Dániel Varró· Proceedings of the ACM/IEEE...· 0 citations
