CacheBridge: Efficient Cross-Model KV Cache Transfer
CacheBridge is introduced, which co-designs architecture-indexed mapper support, attention-aligned calibration, and bounded mapper construction while retaining a closed-form affine interface for online deployment.
Xing-Yu Qu, Si-Yuan Lu, Z. Chen et al.
· 4 citations