Skip to content

Author

Murali Annavaram

We have 4 of 36 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

PACT: NVFP4 Data-Flow LoRA Fine-Tuning on Consumer GPUs

Fine-tuning language models on consumer GPUs is constrained by computation and memory. Although LoRA reduces trainable parameters and optimizer state, frozen projections remain expensive, and activations retained for backward can dominate memory usage. We present PACT, a LoRA fine-tuning system that accelerates frozen...

Lei Gao, Hossein Entezari Zarch, Chao-Yi Jiang et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Output-Aware Rotation for INT2 KV-Cache Quantization

OptR is proposed, an output-aware rotation method that minimizes post-W_O$ attention-output error and applies an attention-equivalent key reparameterization to reduce large channel-wise offsets without changing the softmax distribution.

Vincent-Daniel Yun, Woo-Sang Lim, Minsoo Cheong et al. · 2 citations · ⚡1
#machine learning Preprint Sep 2026

ASPIRE: Asynchronous Batched Self-Speculative Decoding for Long-Context LLM Inference

This work proposes ASPIRE, a non-synchronized batched self-speculative decoding framework built on three components, which achieves speedup in decoding throughput over autoregressive baselines and improves average speedup by approximately $27\% over the strongest prior self-speculative baselines.

Amir Ziashahabi, Hossein Entezari Zarch, Lei Gao et al. · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.