Skip to content

Category

small language model

3,317 papers

#small language model Open access Oct 2026

Separately Trained Senses Converge on Shared Latent Structure: An Empirical Check of Identifiability Predictions Without Shared Data

Identifiability theory for contrastive learning predicts that an encoder trained with suitable positive pairs recovers the latent structure behind its inputs, so separately trained networks that perceive a common world should converge on its shared structure without shared training data. This is one proposed explanatio...

Jonathan Bussing · 0 citations
#small language model Dataset Open access Oct 2026

SankeyQA, career-map Sankey diagrams with exact answers, benchmark data, model replies and code

SankeyQA is an open benchmark for testing whether vision-language models can answer questions about career-map Sankey diagrams, of the kind shown by the XR-CareerAssist virtual reality career guidance platform (VOXReality, Horizon Europe). The data are artificial. All 600 career cohorts, their flow tables and the 1,260...

Nikolaos D. Tantaroudas, Andrew J. McCracken, Ilias Karachalios et al. · 0 citations
#small language model Open access Oct 2026

Verified Self-Training in a Small Language Model: A Prespecified Case Study on GSM-Symbolic (paper, code and results)

Paper (preprint, not peer-reviewed), code, dated decision rules and aggregate results for a single-round verified self-training study with LoRA on Qwen3-1.7B-Base. None of the four sequentially prespecified primary tests met its criterion; the intended human-reference positive control also failed to show improvement. G...

Lewis Adkins · 0 citations
#small language model Open access Oct 2026

Sinapsi: Separating Fluid and Crystallized Intelligence: a Five-Lobe Topology for Continuous Latent Reasoning

In current language models the ability to reason (fluid intelligence) and knowledge about the world (crystallized intelligence) occupy the same parameters, and explicit reasoning must pass one step at a time through a single token. Sinapsi is a modular five-lobe architecture that separates these two components by const...

Marcello 1963- Cozzi · 0 citations
#small language model Open access Oct 2026

Vasist18/Small-Language-ModelsAG: v1.0: Code and data for "Evaluating Cost–Accuracy Trade-offs of Agentic Scaffolds for Small Language Models"

First release accompanying the paper "Evaluating Cost–Accuracy Trade-offs of Agentic Scaffolds for Small Language Models". Includes: Colab notebook that runs all experiments and the analysis Per-question outputs for Qwen2.5-0.5B, 1.5B and 3B-Instruct on 500 GSM8K test problems across six strategies (Direct, CoT, PAL, P...

Vasist18 · 0 citations
#small language model Book Open access Oct 2026

Total Economic Costs of Artificial Intelligence: An Optimization Model of Compliance and Investment Efficiency in High-Risk Systems

Abstract This monograph develops the Total Economic Cost (TEC) model, a formal optimization framework for analyzing regulatory compliance and investment efficiency in high-risk artificial intelligence systems under the European Union’s Artificial Intelligence Act (Regulation (EU) 2024/1689, as amended by Regulation (EU...

Galia Mancheva · 0 citations
#small language model Dataset Open access Oct 2026

Image input token cost by resolution: Claude vs Gemini vs GPT

Input tokens for one image at 10 resolutions (256×256 to a 12 MP photo) on Claude Opus/Sonnet 5.5, Claude Haiku 4.5, Gemini 3.x and GPT. Headline: a 12-megapixel phone photo costs 1,065 input tokens on Gemini, 4,005 on Claude 5.5 and 14,364 on GPT-6 Astra with default settings. Gemini charges about the same for every i...

TokenSave · 0 citations
#small language model Open access Oct 2026

Supplementary Material: Locating and Mitigating Factual Hallucination Circuits in Small Language Models

This project archives the supplementary material for the paper "Locating and Mitigating Factual Hallucination Circuits in Small Language Models via Activation Patching" (submitted to IEICE Transactions on Information and Systems). The paper presents a systematic activation-patching study of context–memory conflict in t...

Shutchon Premchaisawatt · 0 citations

AI-Mediated Translation and Interference in Arabic: Revisiting Toury’s Law in the Age of Digital Language

Thanks to artificial intelligence and machine translation technologies, the volume and speed of translation production have increased. However, these technologies also raise questions about the impact of dominant digital languages on less resourced ones. Many languages remain underrepresented in multilingual modelling...

Sonia Asmahène Halimi · 0 citations
#small language model Open access Oct 2026

Many Tenants, One Cache: Per-Tenant Rotation of the Attention Cache in a Production Serving Engine

Language model serving engines put many customers into one process on one accelerator, sharing one attention cache. Per-tenant rotation stores each tenant’s cached rows under a tenant-specific orthogonal transform and rotates the tenant’s query the same way, so attention is unchanged for the tenant and a read under any...

Luis Carranza · 0 citations
#small language model Open access Oct 2026

Evaluating Small Open-Weight LLMs on Code-Mixed Nepali-English Named Entity Recognition

This paper presents an evaluation of small open-weight large language models (LLMs) on named entity recognition (NER) for code-mixed Nepali-English text. No dedicated Nepali-English NER resource currently exists, to the best of the authors’ knowledge. The LinCE benchmark [Aguilar et al. 2020] includes Nepali-English as...

Binod Raj Pant · 0 citations
#small language model Dataset Open access Oct 2026

Coding in your own language: does the prompt language change what Claude Code and Codex cost?

The same brick-breaker task given to Claude Code and Codex in English, Korean, Japanese, Spanish and Ukrainian, two runs each: input and output tokens, time, cost, whether the game ran, and the language of the game text and code comments. Headline: asking in Korean, Japanese, Spanish or Ukrainian cost about the same as...

TokenSave · 0 citations

From tech blogs

See all →
MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.