AgentServeSim: Serving-System Simulation and Policy Search for LLM Agent Programs
This work presents AgentServeSim, a simulator whose unit of execution is the agent program, and proposes LLM-driven automated agent-serving policy search using AgentServeSim as a CPU-based fitness evaluator.