We have 3 of 17 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
HM-Router is introduced, a routing method that jointly selects a model and harness for each query, with an interaction term inspired by canonical polyadic tensor decomposition to capture how their compatibility varies with the query.
Agentic inference now dominates the LLM inference landscape, requiring LLMs to actively engage in multi-turn interactions with tool-calling capabilities. This introduces a more complex workload for the underlying inference system: serving stages such as prefill and decode exhibit substantially different behaviors and d...
This work presents AOSpec, a lossless framework that co-speculates actions and observations across the full agent-environment loop, and outperforms every practical baseline, reducing mean end-to-end latency by 11.8-32.5% and p99 latency by up to 42.8%.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
