Skip to content

Author

Rahul Mazumder

We have 3 of 152 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Oct 2026

Reconstruction-Optimized Expert Pruning for Mixture-of-Experts Language Models

Mixture-of-Experts (MoE) models reduce computation through sparse expert activation, but deployment still requires storing a large number of expert parameters. We study post-training expert pruning using task-domain calibration data as a subset-selection problem: given a pretrained MoE layer, select a fixed number of e...

Jelena Markovic-Voronov, P. Prastakos, Kayhan Behdin et al. · 0 citations
#artificial intelligence Preprint Sep 2026

ThinQuant: Scalable Rotation Learning for Weight and Activation Quantization of LLMs

ThinQuant is introduced, a data selection procedure which reduces the required number of calibration data points and an exact reduction of the associated optimization on this reduced calibration set using an efficient ADMM algorithm that iteratively employs thin matrix updates at every step, hence the name ThinQuant.

Mehdi Makni, Ryan Lucas, R. Mazumder · 0 citations
Open access Sep 2026

SPLENDID incorporates continuous genetic ancestry in biobank-scale data to improve polygenic risk prediction across diverse populations

It is shown that SPLENDID significantly improved prediction accuracy over existing methods, particularly for non-European and admixed ancestries, particularly for non-European and admixed ancestries.

Tony Chen, Hao-Yu Zhang, R. Mazumder et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.