RouteSparse: Input-Conditional Pattern Routing for Budgeted Long-Context Prefilling
RouteSparse is introduced, which routes each head and prompt segment among a small library of GPU-efficient sparse patterns, andlations confirm that input-conditional routing, hardware profiling, and selective dense fallback each contribute to the quality--latency tradeoff.
Chao Zhang, Yi Ji, Zi-Yan Zhang et al.
· 1 citation