Oct 2026· Proceedings of the ACM on Software Engineering· Vol 3, pp. 3569 - 3590· 0 citations· 38 references
TL;DR
Experimental results on the widely-used Defects4J benchmark show that LTER substantially outperforms the best performance in automated bug reproduction, increasing the reproduction success rate to 46.2% with successfully identifying a valid reproduction test as the top candidate in 38.1% of the cases.
Abstract
Automated bug reproduction from bug reports is a critical yet challenging step in software debugging. While LLM-based bug reproduction shows promise, its effectiveness is often hampered by insufficient contextual awareness of the relevant codebase and a tendency to produce invalid test cases. To address these limitations, we propose a novel approach, called LTER, that enhances LLM-based bug reproduction through fine-grained code entity retrieval and a feedback-driven dynamic repair loop. LTER first identifies specific code entities within bug reports to automatically extract precise contexts, including class definitions, constructors, and method logic. The extracted contexts are then used to guide the LLM in generating reproduced test cases. To further ensure executability, LTER employs an iterative repair mechanism to resolve complex dependencies. Specifically, upon injecting a generated test case into the project, if a compilation failure occurs, the framework forwards the error messages to the LLM for an initial repair. Should this initial repair fail, it empowers the LLM to analyze diagnostic messages to recognize missing context and retrieve indispensable dependencies, subsequently regenerating the test case with the supplemented data. Finally, LTER employs a hybrid cascade ranking strategy to accurately select the most effective reproduction test case from the generated candidates. The experimental results on the widely-used Defects4J benchmark show that LTER substantially outperforms the best performance in automated bug reproduction, increasing the reproduction success rate to 46.2% with successfully identifying a valid reproduction test as the top candidate in 38.1% of the cases. Furthermore, LTER demonstrates strong generalization capability, delivering robust performance on the GHRB dataset containing recent bugs previously unseen by the LLM.
In recent years, the advent of large language models (LLMs) has significantly advanced automatic program repair (APR). However, due to a lack of domain-specific software engineering knowledge, base LLMs are prone to hallucinations during the repair process, which compromises the correctness of the generated patches. Al...
Jia-Xuan Han, Ze-Yuan Zhou, Gang Cao et al.· Software· 0 citations
Reproducing deep learning (DL) bugs is challenging because failures can involve source code, models, data, dependencies, and execution environments. Incomplete bug reports further complicate reproduction by omitting essential details. We present RepGen, an open-source tool for reproducing DL bugs through context-aware...
SmartCode AI is presented, an explainable bug localization and automated repair system that grounds a large language model in retrieved repair knowledge using retrieval augmented generation by combining static analysis, semantic retrieval, generative repair and sandbox validation.
M. Nithya, Mohanapriya A, Mahilmalathi V· International Journal for Re...· 0 citations
Large language models (LLMs) have shown promise for automated program repair, but it remains unclear which debugging signals are most useful and when additional context becomes distracting, costly, or ineffective. We present a controlled empirical study of LLM-based bug fixing on FIXEVAL, comparing three model families...
Dinesh Kumar Gummadavelli, Xian-Shan Qu, Xiao-Peng Li et al.· EAI Endorsed Transactions on...· 0 citations
A no-code fix resolves an invalid bug report by directing the user to change a setting, update to a version where the problem is already fixed, or adjust their workflow. Manually verifying whether a proposed no-code fix resolves the reported bug takes considerable developer time. This study proposes an automated, execu...
U. B. Torun, Veli Karakaya, Eray Tuzun· 0 citations
CuraLoc is introduced, which first selects candidate files and represents their symbols using compact behavioral and structural descriptions and supports different model backbones, with strong localization accuracy demonstrated using both GPT-5.2 and GPT-6 Astra.
Sangeeta Warrier, A. Sankaran, Ryen W. White· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.