Skip to content

Category

small language model

3,629 papers

#natural language process... Preprint Aug 2026

Agents in the Large: Perception-Centered Architecture for Persistent Agents

Pera describes a persistent agent organized around perception and control components that continually perceive service-relevant signals from episodic task executions, internal context, and changes in the surrounding environment, and use these signals to construct lifecycle tasks.

Shi-Han Dou, Haoxiang Jia, Shichun Liu et al. · 1 citation
#natural language process... Preprint Aug 2026

Graph Evidence Is Not Enough: Diagnosing Native Decoder Use in Graph-Augmented LLMs

This work presents S$^2$GE as an instance showing that diagnosis-driven interface design can improve native decoder usability and introduces an intervention triangle with three matched conditions: readable graph evidence, shuffled graph evidence, and no-graph input that separates evidence inclusion, structural readabil...

Xiao-Yu Guo, Peng-Cheng Chen, Jiong Yu et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Stratified Consistency Distillation for Natural Language Formalization

A fine-tuning-based Stratified Consistency Distillation approach that shows significant and consistent improvements in both Pass@K and the novel Equivalent Logical Similarity metrics, demonstrating the potential of advancing logical translation through consistency distillation.

Zhi-Chao Hou, Ferhat Erata, Joseph Lilien et al. · 2 citations
#artificial intelligence Preprint Aug 2026

Beyond Surface Forms: Symbolic Edits as a Test for Logical Reasoning with LLMs

Logical reasoning with large language models (LLMs) is a critical capability, as it reflects a system's ability to correctly deduce hypotheses from a given context using faithful deductive processes. However, LLM reasoning has often been shown to be sensitive to small surface-level variations in problem formulation, ra...

Ramya Keerthy Thatikonda, W. Buntine, Ehsan Shareghi · 0 citations
#natural language process... Preprint Aug 2026

Manac\'a-1B: An Open, Reproducible Brazilian-Portuguese Language Model and a Tokenizer-Aware, Paired Evaluation

Manac-a-1B is the strongest model below the 7B scale, exceeding both Tucano-1b1 and Tucano-2b4 on LAMBADA-PT with large paired margins and is competitive on commonsense completion and near chance on multiple-choice reasoning, as are all small base models.

Bruno Leonardo Santos Menezes, Carlos Leonardo Souza Cardoso, Fábio Porto · 0 citations
#artificial intelligence Preprint Aug 2026

Arkios: An Open Bilingual English-Nepali Language Model Trained From Scratch, with a Devanagari-Aware Tokenizer

We present Arkios, a 1.04B-parameter dense transformer pretrained from scratch on 150B tokens of bilingual English-Nepali text, using a custom single-file C/CUDA training stack and a Devanagari-aware byte-level BPE tokenizer built for this project. On ARC-Easy and ARC-Challenge, Arkios exceeds three comparably sized op...

S. Regmi, Siddhartha Pudasaini, Chetan Phakami Pun · 0 citations
#natural language process... Preprint Aug 2026

Small Language Models as Judges for Rubric-Based Reinforcement Learning

This work studies whether smaller language models can serve as efficient and reliable rubric-based judges, and compares three ways of extracting criterion-level judgments from small models: Generative verdicts, Yes/No Logprob margins, and Probe judges.

Feng-Yu Xie, Yilun Zhao, Bingsen Chen et al. · 2 citations
#natural language process... Preprint Aug 2026

DataFoundry: Evolving Data Preparators via Recursive Self-Improvement

The DataFoundry is introduced, a framework for evolving data preparators through recursive self-improvement before large-scale data production, and it is found that recursively evolved preparators produce training data with higher downstream utility than baselines.

Ce-Hao Yang, Xiao-Jun Wu, Xueyuan Lin et al. · 2 citations
#artificial intelligence Preprint Aug 2026

The Emergent Symbolic Structure of Artificial Neural Networks

It is shown that the vector representations of a variety of neural networks can be closely approximated with symbolic structures, providing a potential way to reconcile longstanding symbolic conceptions of intelligence with the vector-based nature of modern AI.

R. Thomas McCoy, Paul Soulos, Tal Linzen et al. · 2 citations
#natural language process... Preprint Aug 2026

When to Adapt: Conditional Memory Adapters for Retention-Preserving Domain Specialization

Engram Adapter, a framework that repurposes pretraining-time conditional memory as a post-hoc adapter for frozen LLMs, improves in-domain accuracy while preserving 99.4%--100.1% of average OOD performance; on LegalBench it slightly exceeds the frozen base model on average, whereas comparable always-on baselines degrade...

Jiaxuan Hou, Lei Wang · 2 citations
#natural language process... Preprint Aug 2026

Cloud and On-Premises Deployment of Uzbek Legal RAG via Targeted Retriever Fine-Tuning

This work reports on building and operating a retrieval-augmented legal assistant for Uzbek that must run in two regimes: a managed cloud service that maximizes answer quality within a per-token cost ceiling, and an on-premises deployment for clients whose legal data may not leave their infrastructure, restricting us t...

Tatul Danielyan, Mariam Avetisyan, Hrant Davtyan · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.