Preprint
Aug 2026
P-PAS: Prefill-Pressure Adaptive Scheduling for Long-Context LLM Serving
Prefill-Pressure Adaptive Scheduling (P-PAS), a lightweight policy that dynamically adapts the scheduling budget based on concurrent prefill and decode state, is introduced, maintaining low end-to-end latency across changing load regimes, avoiding the limitations of a fixed MBT.
Timo Sämann
· 0 citations