Skip to content

Category

small language model

3,468 papers

#machine learning Preprint Sep 2026

Recipe-Matching, Not Equivalence

Only on MathNet-Retrieve could an inversion, benchmark score up and real retention down, to one edit of a training file be pined, and three trained models are released.

A. Habibullah, M. Alshiekh, Yazan Alshoibi et al. · 0 citations
#machine learning Preprint Sep 2026

Cartridges++: KV Cache Compression without Off-Context Derailment

This study investigates the crucial deployment question of whether Cartridges and other CKVs can handle off-context queries, and proposes Cartridges++, simple modifications to cartridges that retain off-context abilities at small or negligible cost.

Sonia Laguna, João Monteiro, Marco Cuturi et al. · 1 citation
#machine learning Preprint Sep 2026

Persistent Partners Raise Prices Among Learning Agents

When pricing agents meet repeatedly on a platform, the platform decides who faces whom. We ask whether that choice moves the prices the agents learn, and whether a rise comes with learned punishment. In a pre-registered randomised experiment in the Bertrand duopoly of Calvano et al., each agent's price is set by a tabu...

Paul-Peter Arslan, Yubin Kim, Xiao Xiao · 0 citations
#machine learning Preprint Sep 2026

Quality Determines Direction, Length Shapes Magnitude: Length Control for Open-Ended Reinforcement Learning

Quality-Gated Length Advantage Shaping (QGLAS), which first computes advantages from quality rewards alone, then adds bounded bonuses only to shorter positive-advantage responses, leaving all other advantages unchanged, consistently achieves a stronger quality--length trade-off than representative baselines.

Zi-Jun Weng, Zhong-An Bi, Xuan-Ang Gao et al. · 0 citations
#machine learning Preprint Sep 2026

The Low-Rank Structure of VLA Reinforcement Learning

Overall, a systematic understanding of how RL reshapes VLA policies is provided by studying how learned signals are encoded in parameter space, offering insights into more efficient and interpretable VLA post-training.

Minjae Oh, Yoonah Park, Jongwon Lim et al. · 0 citations
#machine learning Preprint Sep 2026

Routing Without Embeddings: Fast And Interpretable Routing With Regular Expressions

RegEXROUTE is introduced, a pipeline that uses sparse autoencoders (SAEs) to discover interpretable regular-expression (regex) features and establishes explicit, interpretable text features as a practical basis for designing and understanding LLM routers.

Yi-Fan Lu, Qi-Yue Zhang, Haotian Shan et al. · 0 citations
#machine learning Preprint Sep 2026

PQ-HSA: Reusing Product-Quantized Scores for Hybrid Sparse-Approximate Attention

PQ-HSA (hybrid sparse-approximate attention) attends the selected tokens with their original keys and values, and the unselected tokens, the background, enter the same softmax through those scores, summed per inverted list and multiplied by the list's mean value.

Kun-Ming Shao, Jie-Run Chen, Yan-Li Wang et al. · 0 citations
#machine learning Preprint Sep 2026

You Only Edit Once: Incentivizing In-Context Capability of LLMs via Local Demonstration Refinement

In-context learning (ICL) is crucial for boosting the inference performance of large language models (LLMs). However, the effectiveness of ICL in LLMs is greatly influenced by the choice of demonstration sets. Exhaustive searches over these sets are combinatorial, and existing selectors often rely on relevance or likel...

Jia-Rong Wen, Qi Wang, Yun Qu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Large Language Models for Automated Cross-Domain Machine Learning Task Type Identification: A Benchmark Dataset and Evaluation

Machine learning task type identification is essential for constructing valid ML pipelines, yet in practice it is typically specified manually. We investigate whether large language models (LLMs) can infer both the data domain and the downstream prediction task directly from dataset-level information when only the targ...

Petros Tsialis, Steffen Limmer, Tobias Rodemann et al. · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.