Preprint
Sep 2026
AgentReplay: Token-Wise Trace Replay Is Essential for Fair Serving System Performance Benchmarking
The experiments show that token-wise replay in AgentReplay effectively eliminates workload variation that greedy decoding and length-wise replay cannot avoid, enabling fairer performance comparisons across serving configurations.
Zai-Feng Pan, Michael Wang, Chris Wu et al.
· 0 citations