DolphinBench: Mapping the Pareto Frontier of Agent Memory
DolphinBench is presented, a benchmark that evaluates memory directly through an agent's task completion and requires all evaluations to report total cost and latency alongside accuracy, which enables us to evaluate agent memory systems holistically.
Soumil Rathi, Deshraj Yadav, Taranjeet Singh
· 0 citations