Long-form reasoning makes inference expensive, and speculative decoding mitigates this cost by verifying multiple draft tokens in parallel. Its speedup, however, can fade as context grows and draft acceptance declines. We focus on attention-mass dilution: as softmax normalizes over more visible Keys, the mass concentra...
Jeonghoon Park, Seo-An Jo, Jongwon Lee et al.· 0 citations
Running GUI agents on edge devices can keep sensitive screens and interaction histories local, but the computational cost of inference at every action step makes deployment challenging. Existing GUI agent systems either perform full vision-language model (VLM) inference at each action step or reuse coarse-grained knowl...
Taehwan Park, Chang-Min Lee, Hayeon Lee et al.· 0 citations
The proposed ACE (Adapter Consolidation across Experts), which groups redundant experts and replaces their expert-specific adapters with group-shared higher-rank LoRA modules under the same PEFT budget, achieves the highest observed mean accuracy among the parameter-matched PEFT methods on the three backbones with comp...
Ahin Lee, Sehyun Yun, Joonha Park et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.