Preprint
Jul 2026
CacheSpec: Finding the Sweet Spot for Small Models in Large Language Models
The results suggest that the sweet spot for small models in large-model inference systems lies not in solving complex tasks independently, but in performing lightweight, structured, and verifiable auxiliary operations.
Jingquan Chen, Jie Feng, J. Piao et al.
· 0 citations