Multi-Agent Change Impact Analysis and Test Optimization for AI-Enabled Software Systems

Abstract

AI-enabled service-oriented systems change through code, data, prompts, service contracts, retrieval indices, and deployment workflows, which makes regression impact difficult to localize with code-centric evidence only. Existing regression test selection methods provide strong code-, configuration-, and service-level signals, but they provide limited guidance on how to reconcile structural, document, semantic, retrieval, and risk evidence when these signals disagree. This paper presents a multi-agent orchestration framework for change impact analysis and budget-aware regression test selection, where specialized agents score various evidence, a coordinator applies a fixed CI/CD budget, and a graph-backed variant records arbitration traces. We evaluate the framework on three case-study systems: an anonymized industrial wellness retrieval-augmented generation (RAG) platform with 300 tests, a microservice application with 150 tests, and a CI/CD pipeline with 60 tests. Each system has six snapshots, producing five evaluated change transitions, with two replicates per transition and the same budget rule across systems. The results are mixed and informative: the base multi-agent configuration is competitive with monolithic fusion, the graph-backed configuration recovers the strongest CI/CD score, and single-signal baselines remain strongest when one impact mechanism dominates. These findings position the multi-agent test selection approach as an observable, configurable decision framework for cross-domain impact analysis rather than a universally superior predictor.