EfficientAgent: What Makes KV Cache Offloading Work for Concurrent Agents?
EfficientAgent is presented, which sizes and manages the host tier by this working set, which estimates the working set from agent histories to size the host tier and its predictions, made before the experiments, located the capacity at which offloading starts to pay.
Kun-Ming Shao, Jie-Run Chen, Jiang-Nan Yu et al.
· 0 citations