Looped language models apply the same stack of layers T times to each token, which deepens the model without adding parameters but multiplies its key-value (KV) cache by T. The larger cache limits how many sequences a GPU can decode at once and slows each decoding step, which reads the whole cache. We propose Hybrid La...
Yu-Han Chen, Si-Yuan Zhang, Nan Wang et al.· 0 citations
Belief-Calibrated Optimization is introduced, a method that writes that belief down as a persistent in-context document and continually revises that document as new candidates are evaluated, and reaches a higher train passrate than a matched control that lacks only the world model.
Yu-Han Chen, Zhi-Hua Tian, Mahavir Dabas et al.· 1 citation
Overall, safety failure is best understood as a disruption of a low-rank output-routing mechanism, and it is shown that LoRA and ASAM mitigate early collapse by suppressing output-side sharpness, but their protection weakens at larger fine-tuning scales.
Yi-Tong Guo, Xiaoyi Chen, Si-Yuan Zhang et al.· 0 citations
ISO-RAG outperforms state-of-the-art baselines by average absolute gains of 10.0% in retrieval recall and 4.3% in downstream exact match, achieving a superior accuracy-efficiency trade-off by fundamentally eliminating the latency bottleneck of global traversals.
Si-Yuan Zhang, Han-Chen Wang, Dong Wen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.