Aug 2026· MethodsX· Vol 17, pp. 104113· 0 citations· 22 references
Medicine
TL;DR
The protocol used to conduct a systematic mapping study of software architecture is described and a method of using large language models (LLMs) together with human evaluators is presented, supported by bespoke open-source software.
Abstract
This article describes the protocol used to conduct a systematic mapping study (SMS) of software architecture. The presence of architectural and design instruction in primary studies cannot be determined through search and superficial review alone. A principled quality assessment must be conducted to identify studies that are both relevant and of high quality. LLM assistance offers practical means of performing such assessments in a timely and efficient manner. Therefore, our contribution is threefold: • Guidance for the following SMS steps: tooling setup, database search, deduplication and snowballing, primary study selection, quality assessment, and data extraction. • The rationale and methodology to perform quality assessment on primary studies regarding software architecture. • A method of using large language models (LLMs) together with human evaluators is presented. The method is supported by bespoke open-source software.
Design and evaluation of Software Reference Architecture (SRA) is a complex task. This paper aims to collate the overall design and evaluation strategies that have been in practice for the last 15 years. It oversees the publication trend, components of SRA design, knowledge sources, developed artifacts, and evaluat...
S. Chand, B. Kumar, Elisha Yumi Nakagawa· Applied Computing and Inform...· 1 citation
A Systematic Mapping Study on the quality of AI-based software identifies six recurring challenge categories, with the most prominent being limitations in existing quality assessment models followed by issues in non-functional requirement management, quality-aware development, and quality assurance.
Maryum Hamdani, Mateen Ahmed Abbasi, Marko Jäntti et al.· 0 citations
A systematic mapping review through a search for studies that answered the research question, ‘‘Which software tools (commercial, free or research based) are available to support Global Software Engineering?’’ found that out the total of 132 tools, the majority of tools were developed at research centers, and only a sm...
D. R. Naik, S. Leelashyam, M. Venkataratnam· Journal of Science & Tec...· 0 citations
A lifecycle-aware framework that integrates quantitative software quality assessment with Large Language Model (LLM)-based code refinement is proposed and the potential of metric-driven LLM feedback for research software quality improvement is demonstrated while highlighting its inherently multi-objective nature.
Nafis Tanveer Islam, N. Soveizi, Yutong Li et al.· 0 citations
This Systematic Literature Review examines prompt engineering in automatic code generation using large language models (LLMs) and shows that prompt engineering has been established as a key discipline for optimizing interaction with LLMs and improve the accuracy, robustness, and applicability of the generated code.
E. Camacho, Y. Gutierrez, César Pardo· 0 citations
The software bill of materials (SBOM) has emerged as an important mechanism for software supply chain transparency following high‐profile attacks such as Log4Shell and SolarWinds. However, the practical value of an SBOM depends entirely on its accuracy and completeness, which are shaped by the capabilities and limita...
M. Mydin, D. Beh, S. Shariff· Applied Research· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
