Author

S. Shenker

h-index 12 View on Semantic Scholar

We have 2 of 48 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Sep 2026

Token Latency Fairness: Performance Isolation for Multi-Tenant LLM Serving

FairInference provides the novelelta-token fairness guarantee: for a well-behaved client, if a token is generated in d time units in isolation, it will be generated within d + {\delta} time units in multi-tenant execution, providing strong latency isolation guarantees for LLM serving.

Dev Bali, Soujanya Ponnapalli, Yi-Chu Wang et al. · 0 citations

#artificial intelligence Preprint Sep 2026

mKernel: Fast Multi-GPU, Multi-Node Fused Kernels

Communication has become a bottleneck in distributed training and inference of large models. Overlapping communication with computation at the granularity of kernels, on separate streams, reduces only part of this communication cost. Fused kernels often have better performance by transmitting each output tile as soon a...

Zi-Ming Mao, Yi-Han Zhang, S. W. Chew et al. · 0 citations