SRE-Marathon: A Continuous, Change-Driven Benchmark for Autonomous Site Reliability Agents
Benchmarks for site reliability engineering (SRE) agents are typically episodic: one fault is injected, the agent receives an incident task, and its response is scored. Production operation is not. Incidents surface through noisy alerts, overlap in time, and often originate from code or configuration changes. We presen...
Yi-Fang Tian, Ying-Jian Bai, Yi-Feng He et al.
· 0 citations