DISCO: Distributed Long Context Scaling with Grounding-Reasoning Disaggregation
Inspired by distributed computing frameworks like Apache Spark, DISCO partitions long context across a fleet of Worker LLMs dedicated exclusively to parallel, localized grounding, establishing a highly efficient paradigm for robust long-context inference.
Guan-Zheng Chen, Viet Dac Lai, Subhojyoti Mukherjee et al.
· 0 citations