Skip to content

Category

small language model

3,573 papers

#small language model Preprint Sep 2026

Beyond Shadow Weights: Quantization-Aware Training as Quantized-Endpoint Descent

An idealized model for the residual phase is proposed, which records where each shadow weight sits inside its quantization cell as a fraction of the cell width as a fraction of the cell width, which leads to a crossing law that determines which coordinates cross quantization boundaries after a shadow update.

Sheng-An Xu, Hanyang Li, Jian-Hao Ma et al. · 1 citation
#small language model Preprint Sep 2026

Labelling Bug-Fixing Commits with Local Open-Weight Language Models

This paper examines whether commits can be labelled as bug fixes from their content alone, using open-weight language models that run locally and therefore keep the process reproducible, inexpensive at corpus scale, usable on proprietary code, and independent of any issue tracker.

Philip König, Georg Goldenits, Caroline König et al. · 0 citations
#small language model Preprint Sep 2026

Two Fault Lines: Latent Polarity Geometry in X Community Notes

It is argued for a bridging model with more than one axis of disagreement, and for recruiting raters in the languages the current design reaches least, for recruiting raters in the languages the current design reaches least.

Andreas Andreou, M. Sirivianos · 0 citations
#small language model Preprint Sep 2026

What Stops a Small Language Model From Driving a Database Agent

Small open-weight language models are assumed to fail at agentic database work because they lack the reasoning capacity for it, and a test against a production system finds that that assumption is false.

Cevheri Bozoglan, Yusuf Gundogdu, Abdullah Kaya et al. · 0 citations
#small language model Preprint Sep 2026

Towards Zero-Shot Attribution of Synthetic Speech via Audio-Text Contrastive Retrieval

This model couples a frozen Wav2Vec2-BERT audio encoder with a frozen E5 text encoder and aligns them through small trainable projection heads, using a contrastive objective that combines a cross-modal supervised-contrastive loss with intra-modal terms.

Cristian-Teodor Neamtu, Serban Mihalache, Stefan Smeu et al. · 0 citations
#machine learning Preprint Sep 2026

Configurable Multi-Stage Vision Pipeline for Crop Disease and Pest Diagnosis

Farmer.Chat is Digital Green's farm advisory service for smallholder farmers. When something looks wrong with a crop, the farmer takes a photograph and sends it, and that photograph is the whole question: no symptom described, no crop named, often no text at all. The service has to determine whether the picture can be...

Naga Ganesh, S. ChandrashekarM, Lakshmi N. Pedapudi et al. · 0 citations
#machine learning Preprint Sep 2026

The Weight Is Over - Interactive Diffusion on Consumer GPUs

An embedding translator that maps a small text encoder into a large encoder space to cut weight and latency; a reproducible sweep recipe for navigating the speed/quality/memory triangle in diffusion pipelines; and an interactive on-device image generation editor achieving sub-second TTFI on recent GPUs are made.

F. Ganz, Maximilian Mueller · 0 citations
#machine learning Preprint Sep 2026

IntBMoE: Integrating Block-Level Conditioning into Expert Composition for Full-Participation Mixture-of-Experts

IntBMoE is a block-conditioned MoE that decouples all three by pairing dense expert composition with sparse block execution, and shows consistent gains over representative sparse and dense MoE baselines on image classification.

Ran Cheng, Long-Fei Xu, Zheng Liu et al. · 0 citations
#machine learning Preprint Sep 2026

Fast And Accurate Text Content File Type Identification

A common requirement across organizations is to have a tool that can identify file types based on their contents, particularly in the cybersecurity domain where magic numbers and file extensions can not be trusted. While existing tools work well in practice, there is plenty of room for improvement either in terms of co...

Manu Nandan, Michael Brautbar, Edward Raff · 0 citations
#artificial intelligence Preprint Sep 2026

Samsone: A Family of Open Small Audio Language Models for On-Device Inference

The core model, Samsone-134M, establishes a new state-of-the-art for its size class across multiple benchmarks, and the scaling laws of SALMs are explored by introducing Samsone-99M and Samsone-356M, a family of SALMs designed for edge computing.

Piotr Masztalski, Michal K. Grzeszczyk, Olaf Sikorski · 0 citations
#artificial intelligence Preprint Sep 2026

SpecOpt: Contact-Diff Reasoning for Agentic Molecule Optimization Toward Binding Specificity

Off-target protein binding is a major source of adverse effects for small-molecule drugs, yet most structure-based molecular design methods focus on generating selective compounds de novo rather than improving the selectivity of existing, well- characterized drugs. We introduce specificity optimization (SpecOpt), a mol...

Thao Nguyen, Heng Ji · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.