Skip to content

Category

small language model

3,445 papers

#machine learning Review Oct 2026

Multi-Label Topic Assignment via LLM Distillation: A Comparative Analysis of Generative vs. Discriminative Student Models

Multi-label topic assignment for user-generated content (UGC) -- including product reviews and buyer-seller conversations -- poses unique scalability challenges in large-scale e-commerce due to informal language, extreme label sparsity, and rapidly evolving taxonomies. While utilizing Large Language Models (LLMs) as la...

Sourabh Kasliwal, Shubhranshu Singh · 0 citations
#artificial intelligence Preprint Oct 2026

Decoupling Logic from Persona: Structural Immunity of Edge LLM Agents to Context Pollution

Small language-model agents on edge devices must hold a persona and reason correctly at once, inside one context window that fills with conversational history and persona instructions. We study what happens to the logical part of such an agent when that history is long, misleading and persona-heavy (persona-logic inter...

Masaaki Nakatsu, Ren-Xiong Wang · 0 citations
#artificial intelligence Preprint Oct 2026

Which Language Should a Skeleton Speak? Language Choices in Multilingual Reasoning

Skeleton-based reasoning prompting is a promising training-free approach for structuring LLM reasoning, but prior work largely assumes an English-centric setting. We propose the Language-Aware Skeleton Exploration Framework (LASEF) to study skeleton-language choice in multilingual mathematical reasoning. Across math be...

HyeonSeok Lim, Seung-Woo Song, Inho Won et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Collaborative Reasoning Distillation via Cross-Feedback and Coherent Curation

Reasoning capabilities are critical for advancing Large Language Models, yet current approaches either require massive computational budgets or struggle to effectively distill reasoning to smaller models. Standard distillation methods rely on outcome-based rewards, failing to distinguish between sound reasoning and luc...

Tae-hong Kim, Seunggeun Cho, Dong-Su Han · 0 citations
#artificial intelligence Preprint Oct 2026

Correspondences as Decisions: JevNexus for Decision-Centric Schema Matching

Schema matching increasingly uses generative language models to rerank retrieved column candidates, although the underlying task is a bounded correspondence decision. We present JevNexus, which combines typed pairwise decisions with schema/instance evidence and invokes listwise refinement only when the evidence disagre...

Run-Ze Li, Han-Chen Wang, Ying Zhang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Mixture of Layers: Dynamic Layer Routing for Visual Reasoning

Pre-trained vision encoders contain layer-wise visual representations that differ in spatial granularity, semantic abstraction, and sensitivity to local details. However, most Multimodal Large Language Models (MLLMs) rely on only the final or penultimate vision encoder representations or fixed aggregation rules, making...

Jeonghwan Kim, S. Stoica, Ji-Wan Chung et al. · 1 citation
#artificial intelligence Preprint Oct 2026

Multi-Objective Aligned Small Language Model Framework for SUD Patient Dialogue Generation

Substance Use Disorder (SUD) counseling requires patient responses that reflect underlying cognitive states such as beliefs, coping strategies, and readiness for change. Although large language models (LLMs) can generate fluent text, they often fail to produce cognitively coherent and clinically realistic patient behav...

Thushara Manjari Naduvilakandy, Hyeju Jang, M. Al Hasan · 0 citations
#artificial intelligence Preprint Oct 2026

sk-bench: A Native-First Benchmark for Evaluating Large Language Models in Slovak

Multilingual LLM benchmarks omit Slovak, a morphologically rich West Slavic language of five million speakers, or cover it only by machine translation. We present sk-bench, a native-first Slovak benchmark with 30 datasets (33 scored task variants) across ten skill categories. Eleven resources are introduced or first pa...

Marek Suppa, Ivan Vykopal, Andrej Ridzik et al. · 0 citations
#artificial intelligence Preprint Oct 2026

UniSkill: Learning Actor-Aligned Skill Proposals for an Evolving Policy

Large language model agents can improve across tasks by retaining reusable skills distilled from prior interactions. Recent work jointly optimizes task execution and skill extraction, enabling the policy and skillbank to co-evolve. However, as the actor continues learning, rewarding skill proposals through their reuse...

Yi-Fei Lu, Cheng Liu, Dian-Zhi Yu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Efficient Reasoning with Flow Language Models

Flow Language Models (FLMs) have emerged as a continuous-state alternative to discrete diffusion language models, yet the role of their continuous representations in reasoning remains unclear. We investigate this question by comparing the reasoning efficiency of FLMs and discrete diffusion models, measured by solution...

Han-Ru Bai, Faissal Izermine, Oscar Davis et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Breaking the Space Barrier and its Application to Language Model Inference

Language models are more and more often asked for structured output: JSON that follows a schema, or a tool call with typed arguments. A small machine, an automaton, enforces the format by forbidding the tokens that would break it. We observe that this machine has a rare property: from any of its states, each token lead...

A. Asadulaev · 0 citations
#artificial intelligence Preprint Oct 2026

Not Every Call Needs a Frontier Model: Per-Call-Site Evaluation of Small Language Models in a Deployed Agentic Home-Automation System

An agentic system issues several structurally different kinds of LLM calls. It routes intent, classifies actions, grounds language in a device registry, plans multi-agent pipelines and writes the Python code those pipelines run. The difficulty of these call sites varies by an order of magnitude, yet in practice a singl...

P. Kasnesis, Christos Chatzigeorgiou, Lazaros Toumanidis et al. · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.