XRepoSkill, a trajectory-based approach for learning transferable skills that achieves the highest issue resolution rate in all six benchmark--LLM combinations, and is evaluated on the challenging long-horizon DeepSWE benchmark.
Yao-Qi Guo, Hao Zhou, Jia-Yi Zhang et al.· 0 citations
This work conducts the first empirical study to systematically investigate the test adequacy of harness in real-world agentic systems and proposes HarnessTester, the first harness-oriented test generation technique that incorporates explicit agent-harness contract support to construct contract-faithful test setups and...
Yi-Fan Xiong, Jing-Yi Ge, Zhen-Peng Chen et al.· 0 citations
Agent harness bugs exhibit unique characteristics and remain challenging for state-of-the-art software agents to repair. Progress in this area is further hindered by existing benchmarks, which contain only a small and fixed number of executable harness bugs while requiring hundreds of human hours to construct. This wor...
This work introduces Mubric, a mutation testing-guided approach to rubric generation, which achieves the highest overall evaluation accuracy, outperforming the strongest baseline by 7.48 percentage points.
Jiayuxuan Yang, Jie M. Zhang, Yiling Lou et al.· 0 citations
A reuse paradox is revealed: although skills are intended to be easily imported and reused, developers spend a lot of effort rewriting what the skills do, fixing skill discoverability, and translating them for different tools and languages, indicating a need for better abstractions, standardized interfaces, and automat...
Xinjian Wu, Jingzhi Gong, Gunel Jahangirova et al.· 0 citations
This paper proposes SafeKeep, an inference-time safeguard that decouples safety judgment from tool execution: it assesses requests using flattened textual tool specifications while retaining the original schema-formatted specifications for execution.