Skip to content

4 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Nov 2026

SGA-Sparse: Training Native SwiGLU Gates for Activation-Sparse and Low-Bit LLMs

The introduction of SGA-Sparse is introduced, which converts pretrained SwiGLU LLMs into fixed-budget activation-sparse models by training the existing gate projection directly as a top-k router, and establishes native-gate training as a practical approach for combining high FFN sparsity with low-bit weights.

Ruokai Yin, Steven Li · 0 citations
#artificial intelligence Preprint Oct 2026

Few Bits, One Law: Toward W2A4KV2

Extreme low-bit LLM compression is most challenging when weights, activations, and KV caches are quantized together: their distributions differ, and quantization errors interact throughout the network. We introduce CanonQ, a unified quantization-aware training framework that addresses these challenges by separating sou...

Kai Yi, Tarek Elgamal, Sruthikesh Surineni et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Humanity's Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal Models

Humans perceive far more in a scene than what is explicitly depicted: a single glance captures past causes and future trajectories; a quick peek determines if a vehicle can fit between two parked cars; a few seconds of video reveals who holds authority in a room; and a fleeting clip highlights subtle abstract patterns...

Xing-Ming Guo, Jing Gu, Brian Jang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

SteerDuplex: Steerable Duplex Speech Dialogue Models

SteerDuplex is introduced, a Moshi-based full-duplex speech model fine-tuned on natural conversations and synthetic dialogues targeting instruction following, vocal delivery, reasoning, and duplex interaction, and two-stage reinforcement learning with hybrid rewards to improve timing and response continuity.

Utkarsh Tyagi, Ramaneswaran Selvakumar, Advait Gosai et al. · 3 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.