This work presents Coda, a coding-agent serving system that realizes admission flexibility through a readiness-informed admission layer incorporating two mechanisms: Tiered-Aging state admission exploits bounded flexibility in admission order to improve admission efficiency and preserve request progress.
You-He Jiang, Fang-Cheng Fu, Bin-Hang Yuan et al.· 0 citations
GPUs are expensive resources but often underutilized. This inefficiency is exacerbated by the increasing diversity of AI workloads, where small or specialized models often fail to saturate high-capacity devices, necessitating GPU sharing. Existing sharing approaches force a hard tradeoff. They either partition hardware...
Yi-Cheng Liu, Yi-Fan Qiao, Tian Xia et al.· Proceedings of the 32nd ACM...· 0 citations
This work presents Crossflow, which makes this boundary elastic without changing node roles, and improves token throughput by 16.2-17.4% on geometric mean over static P/D, and by up to 43.4% at high load, while reducing mean TTFT at every evaluated point.
Yi Xu, Ehsan K. Ardestani, Wen-Yin Fu et al.· 0 citations
This work presents EMA, a memory sharing system that allows GPUs within a server to borrow and reclaim memory from each other, forming an elastic pool of capacity, and ensures performance transparency for both borrowers and lenders.
Yi Xu, Tian Xia, Ion Stoica· arXiv.org· 0 citations
Occamy-1.0, a cost-efficient co-work model obtained by further training the post-trained Qwen3.6-35B-A3B checkpoint, is presented and placed at the low-cost knee of the observed cost--performance Pareto frontier.
Wen-Hui Chen, Shi-Wen Cheng, Hao Dong et al.· 3 citations
QK-Restore consistently restores long-context capability at zero training cost while preserving reasoning performance; for instance, on HypeNet-5B it improves S3@256K from $65.4\%$ to $76.4\%$ while maintaining strong reasoning performance.
Xinyu Zhou, Boyuan Zhu, Yi Xu et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.