This work presents SpecBox, a runtime built around speculative sandbox preallocation tailored for dynamic LLM agent execution pipelines, and implements keyword matching and streaming semantic embedding to enable intent-driven sandbox prewarming, which identifies pending tool execution demands mid-LLM token generation a...
Yi-Hui Zhang, Tian-Yu Wo, Jing-Hao Wang et al.· arXiv.org· 1 citation
This paper presents a tutorial-style, collective-centric taxonomy for collective communication, which organizes recent advances into three layers: communication planning, which generates topology-aware collective schedules; communication execution and adaptation, which maps these schedules onto GPU runtimes and hardwar...
Xue-Bin Song, Menghao Zhang, Yue Liu et al.· IEEE Network· 0 citations
HyLink is introduced, a two-layer collective communication framework, including a PCIe CCL module and a Multipath Orchestrator module that provides a CPU-driven Domain-Specific Language (DSL) for multi-stage data flows and an auto-pipelined transfer engine for host-side routing and SIMD-accelerated reduction.
Yue Liu, Menghao Zhang, Xuebin Song et al.· Asia-Pacific Workshop on Net...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
