This work presents MeshRT, the first wafer-scale system to achieve both ultra-low latency and high throughput for LLM inference via a novel system architecture, which is called compile-time governance of runtime dynamism.
Cong-Jie He, Le Xu, Zhan Lu et al.· Proceedings of the ACM SIGOP...· 0 citations
Wavel is presented, a fast and efficient compilation system for wafer-scale accelerators that introduces MeshIR to make executable schedules explicit, constructs them through two legal locality-preserving primitives, CUT and TUNE, and uses physical cost evaluation with structured pruning to keep search practical.
Ye-Qi Huang, Cong-Jie He, Hao-Cheng Xiao et al.· Proceedings of the ACM SIGOP...· 0 citations
A remote Spectre attack that leaks a JWT token from a co-located victim worker in the Cloudflare Workers production environment is demonstrated, outperform the existing attack by orders of magnitude.
Martin Schwarzl, Hao-Cheng Xiao, Albert Pedersen et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.