3 papers indexed here
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
Computation Is Fast, Use Threadlet!: Efficient Threading for μs-Scale Computing via OS/Hardware Co-Design
This work proposes threadlet, a new hardware abstraction that is lighter than a software thread by removing uncritical state, and builds a supporting architecture on an FPGA and a research OS for threadlet, outperforming prior works by 3× to 47× on real-world applications.
Adaptive Context Parallelism for Production LLM Serving
Vertumnus is presented, an adaptive CP serving system designed for heterogeneous and evolving workloads that reduces mean TTFT and improves token-weighted SLO attainment and introduces a global prefix-cache management policy that coordinates cache placement and replication among workers with the same or different CP de...