Skip to content

Category

small language model

3,629 papers

#natural language process... Preprint Sep 2026

StochBench: A Domain-Specific Benchmark for Stochastic Processes in Lean

StochBench is introduced, a Lean 4 benchmark of 450 graduate stochastic-processes problems at varying abstraction levels, each paired with its natural-language source that better represents domain-specific applied mathematics while remaining challenging for advanced provers.

Idan Davidovich, Debargha Ganguly, Vikash Singh et al. · 0 citations
#machine learning Preprint Sep 2026

Privacy-Preserving Split Learning for Federated LLM Fine-Tuning

This work addresses leakage through a learned obfuscate-and-recover scheme that protects participants' private datasets while still allowing an independently deployable model to be trained on the server side, making split-based federated LLM fine-tuning practically viable.

Heng Jin, Chao-Yu Zhang, He-Xuan Yu et al. · 1 citation
#artificial intelligence Preprint Sep 2026

Show-Harness: Just a VLM Agent Can Play Robots

Show-Harness, an Embodied Harness that enables VLMs to"play" robots through a compact semantic interface linking intent to action, and develops GUMI (GUI Manipulation Interface), which extends the same semantic action space to GUI-based demonstration collection, allowing humans and agents to"play"robots across embodime...

Yan-Zhe Chen, Ze-Chen Bai, Zhi-Jun Cao et al. · 26 citations · ⚡2
#artificial intelligence Preprint Sep 2026

Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMs

This work proposes Forgetting Only What Matters via Unlearning Layers (FOM-UL), a layer-level unlearning framework that selects transformer layers using a forget-to-retain significance score and provides an empirical path toward quantization-resilient unlearning.

Ravi Ranjan, O. Kotevska, Agoritsa Polyzou · 3 citations
#artificial intelligence Preprint Sep 2026

RiLM: Parameter-Efficient Language Modeling via Geodesic Decoding

Penn Treebank and a 10k-vocabulary stress test confirm that geodesic decoding transfers across corpora and larger |V|, while hyperbolic curvature helps selectively, and characterize boundary collapse in naive hyperbolic recurrence and show how Mobius stabilization restores trainability.

Fang Li · 0 citations
#artificial intelligence Preprint Sep 2026

When Auditors Fabricate: Batch-Size Degradation and Confident Hallucination in LLM Detection of Planted Document Contamination

It is concluded that LLM document auditing degrades not gracefully but deceptively, and the harness such systems require: bounded batch sizes, direct content injection, and mechanical verification of every reported finding against source text is outlined.

K. Parekh, Sanjana Pendyala Ravinder, Sana Mhapsekar et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Looped GPT-BERT: Trading Parameters for Computation in Small Language Modeling

When training data are limited, increasing parameter count is not the only way to improve language-model performance. A small parameter set, when repeatedly applied, can also deliver comparable performance. We study Looped GPT-BERT in the BabyLM 2026 Strict-small setting, combining GPT-BERT's masked next-token and caus...

Ting-Shuo Fan, Hong-Tao Mu, Tian-Yun Zhou et al. · 0 citations
#artificial intelligence Preprint Sep 2026

From Fixed Keys to Readable Schemas: Small Language Models for Vehicle Agent Function Calls

In-vehicle assistants must translate natural-language requests into accurate vehicle function calls under strict memory and latency constraints, making small language models (SLMs) attractive for on-device deployment. For such models, a key design choice is how the available function surface is presented. Two approache...

Hamed Jafarzadeh Asl, Yuanhao Yu, Vahid Partovi Nia · 0 citations
#artificial intelligence Preprint Sep 2026

Edu-QuRating: Multi-Dimensional Educational Data Curation with Distilled Pairwise Judgements

E Edu-QuRating is introduced: a pipeline for multi-dimensional educational data scoring and curation that defines education-specific rubrics, uses an LLM judge to label sampled document pairs and distills those pairwise preferences into reusable Edu-QuRaters, which can score individual text chunks on a set of education...

Oliver G. B. Garrod, Robin A. A. Ince, Meng Liu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning

Retrieval-augmented generation (RAG) grounds a language model in retrieved documents, which reduces hallucination but creates a new attack surface: if retrieved text is tampered with, the model may repeat the falsehood. We study how much a small quantized model, Llama 3.1 8B, degrades when a fraction of its retrieved c...

Iliano Fasolino · 0 citations
#artificial intelligence Review Sep 2026

RAP: Research Attention Prediction Reveals Target-Conditioned Evidence Acquisition Biases

Research Attention Prediction (RAP), a rolling benchmark covering 278 AI/ML fields and 1,390 episodes, is introduced, a rolling benchmark covering 278 AI/ML fields and 1,390 episodes for large language models to track shifts in research attention.

Ying-Qian Wu, Jingcong Liang, Si-Yuan Wang et al. · 0 citations
#small language model Open access Sep 2026

Retrieval-Augmented Generation for Question Answering over a Research Paper: A Hybrid Dense-Keyword Retrieval Study on the Transformer Architecture Paper

Retrieval-Augmented Generation (RAG) combines information retrieval with language generation to improve the grounding of generated answers in a source document, addressing a central weakness of purely parametric large language models: the tendency to produce fluent but unsupported statements. This study designs, implem...

Dileep Choudhary · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.