TestAgent, a multi-agent tool implemented as a VS Code extension that automates the generation of high-quality unit tests for Java projects using repository-level Code Knowledge Graphs, demonstrates its practical utility for regression testing and bug discovery.
Abstract
Automated unit test generation plays a critical role in maintaining software quality, yet existing LLM-based tools often struggle with limited repository-level context and rigid generation workflows. In this paper, we present TestAgent, a multi-agent tool implemented as a VS Code extension that automates the generation of high-quality unit tests for Java projects using repository-level Code Knowledge Graphs. Unlike existing tools that rely on coarse-grained workflows, TestAgent mirrors the structured practices of human developers, who typically analyze requirements before writing tests and review results afterward, by coordinating three specialized agents: a Planner to derive testing requirements, a Generator to synthesize executable code via tool-assisted retrieval, and a Reviewer to iteratively refine tests based on execution feedback. Evaluation on 1,451 methods across six Java projects demonstrates that TestAgent achieves a 92.34% line coverage, significantly outperforming baselines like EvoSuite and ChatUniTest. Furthermore, the tool successfully detects 154 real-world bugs with high precision (92.22%), demonstrating its practical utility for regression testing and bug discovery. The tool source code and demonstration are available at: https://github.com/iSEngLab/TestAgent-VSCode-Extension.
TestAgent is proposed, an LLM-based test generation approach that addresses the above limitations by emulating human testing practices via a multi-agent collaboration mechanism and equips TestAgent with a set of tool APIs that can be invoked dynamically in an on-demand and adaptive manner.
Quanjun Zhang, Ye Shang, Siqi Gu et al.· 0 citations
TDD-Agent is introduced, which operationalizes the test-driven development paradigm for code generation and improves not only code correctness but also the effectiveness of the generated tests, yielding higher pass rates, coverage, and mutation scores, suggesting that tests can serve as evolving reasoning artifacts rather than fixed validators.
Hong Yu, Ke-Shen Li, Jiakun Li et al.· 0 citations
While Transformer-based Large Language Models (LLMs) have advanced NLP, achieving an efficient automated development workflow in multi-agent systems remains challenging due to issues in code accuracy, testing effectiveness, and agent collaboration. To address these limitations, we propose UMLCoder, a novel multi-agent collaborative code generation framework designed to enhance software reliability and maintainability. UMLCoder comprises four specialized agents: a UML Expert Agent for generating precise structural diagrams to guide programming, a Code Generation Agent, a Test Case Generation Agent, and a Test Execution Agent for robustness verification. Benchmark evaluations demonstrate that UMLCoder achieves a pass@1 score of 71.9% on HumanEval and 70.3% on MBPP. Compared to baselines like GPT-3.5-turbo and LLaMA3, the proposed framework significantly improves code quality and computational efficiency, reducing the time complexity from $O\left(n^{2}\right)$ to $O(n)$ in specific scenarios.
Kehao Mao, Ruixi Lin, Guanyu Lu et al.· 2026 6th International Confe...· 0 citations
SWE-RPG is introduced, a repository-level benchmark that combines executable patch evaluation with validated ground-truth references (GTs) for Requirement Clarification and Implementation Planning, and suggests implicit-requirement recovery as a key candidate direction for improving coding agents.
The AgentCodeReview system is presented, a multi-agent system that is able to conduct explainable code review and automated bug repair by leveraging software engineering agents with different code review tasks and its utility and extensibility to the field of explainable AI in software quality assurance are demonstrated.
B. N, T. L. Manasa· International journal of com...· 0 citations
ReProAgent is a multi-stage agent framework for reproduction test generation from issue reports that decomposes the task into four agent stages: bug localization, root cause analysis, test planning, and test generation, and generalizes across multiple backbone LLMs.
Quanjun Zhang, Yi Zheng, Ye Shang et al.· 1 citation