Skip to content

Category

small language model

3,317 papers

KiranaBench: Can a Language Model Run a Neighbourhood Shop?

Large language model (LLM) agents are increasingly evaluated on long-horizon tasks, including autonomously running a business. Existing benchmarks for this setting are almost exclusively English-language, Western in retail context, and single-agent, with the agent observing the business directly. We study how these res...

Bhuvan Arora, Ankita U. Karmakar, Chaitanya Jain et al. · 0 citations
#natural language process... Preprint Oct 2026

On the Position Bias of Large Language Models: A Comprehensive Study

Recent studies have shown that position bias remains a critical vulnerability in large language models (LLMs), undermining both the integrity of multiple-choice evaluations and the reliability of retrieval-augmented generation. However, existing understanding of this phenomenon is largely derived from studies with limi...

Yi-Ning Li, Huayang Li, Le-Mao Liu et al. · 0 citations
#machine learning Preprint Oct 2026

Look, Reason, Draw a Region: Recursive Refinement for Spatial Context Prediction

Spatial context prediction requires visual grounding and spatial reasoning to identify vacant regions relative to objects in a scene. Spatial relationships and physical constraints remain challenging for large vision-language models (VLMs). Recursive reasoning has demonstrated strong performance on discrete and abstrac...

Wajeeha Tahir, Anna Tegon, Lionnus Kesting et al. · 0 citations
#machine learning Preprint Oct 2026

How Murky Before a VLM Knows It Cannot See? Accuracy, Confidence and Abstention on a Physical Visibility Axis

Robustness studies of vision-language models (VLMs) grade degradation on nominal severity scales ("level 1-5") that carry no physical units, and they rarely ask whether a model's confidence follows the loss of visibility. We measure accuracy, internal (token-probability) confidence, verbalized confidence and an explici...

Mochamad Rizal Fauzan, Irgi Surya · 0 citations
#artificial intelligence Preprint Oct 2026

Aligning Language Models Towards Counterfactual Invariance

Small variations in prompt characteristics can meaningfully alter the semantics, tone, and contextual assumptions of large language model outputs. Such characteristics can involve group variables such as demographics or other sensitive latent attributes. Sensitivity to such input variables is undesirable when demograph...

B. Demir, Emma Shen, Ksheeraj Sai Vepuri et al. · 0 citations
#machine learning Review Oct 2026

FederatedBytes: Tokenizer-Free, Byte-Level Small Language Models for Efficient Multimodal Federated Learning

Federated Learning (FL) is a powerful machine learning framework that allows building a global model from the contributions of multiple, distributed clients, while ensuring the privacy of their local data. However, its heavy computational and communication overheads challenge its use for contemporary AI workloads such...

Ali Sarabadani, Massimo Piccardi, M. Abolhasan et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Beyond Marginal Influence: Interaction-Aware Memory Selection for LLM Agents

LLM-agent memory selection often uses retrieval rankings based on record relevance or individual influence. Such rankings cannot identify sufficient subsets under redundant or jointly necessary evidence. We study per-decision memory sufficiency: selecting a small subset that preserves full-memory behavior. To separate...

B. Subrahmanyam, Neeraj Choudhary · 0 citations
#machine learning Preprint Oct 2026

Sample, Mix, or Verify? Allocating Test-Time Compute under Imperfect Verifiers

A common way to make language models and agents more accurate is to spend more compute at inference time: generate many candidate solutions and submit the one a verifier prefers. Success then requires that some candidate is correct and that the verifier picks it. The first grows predictably with the number of samples;...

Srinivasan Iyengar · 0 citations
#artificial intelligence Preprint Oct 2026

Local proxies for memory-efficient training

Local learning algorithms can reshape resource requirements of artificial intelligence. The memory bottleneck of standard end-to-end backpropagation lies in the need to store all network activations until the loss gradient has been propagated back through. Local learning avoids this, but typically at a cost in accuracy...

Wu-Zi S. Han, Brian A. Yuan, G. Bellec · 0 citations
#machine learning Preprint Oct 2026

Towards Looped Models Done Right, Part I: Topology, Input Injection, Recurrent-State Design

Looped language models reuse physical Transformer blocks across logical depth, but established architectures entangle recurrence placement, input injection, and recurrent state organization. We isolate these axes in models trained from scratch at matched parameter scale, logical depth, and token budgets, and then test...

Benhao Huang, Chu-Fan Shi, Jun-Lin Chen et al. · 4 citations
#machine learning Open access Oct 2026

Beyond accuracy in crop classification: calibration, selective prediction, and robustness

Introduction: Near-perfect crop-label accuracy can conceal uncertainty, perturbation sensitivity, and weak explanations. This study evaluates these reliability dimensions without treating benchmark classification as an agronomic recommendation. Materials and methods: Ten classifiers were evaluated using five matched st...

Kwan Hong TAN · 0 citations
#artificial intelligence Review Open access Jan 2021

Data Quality, Feature Engineering, and Model Reliability in Large-Scale AI Multi-Agentic Systems

A conceptual framework linking data quality assurance, feature engineering, model training and reliability testing, and deployment to an agent population is proposed, closed by a cross-agent monitoring and feedback loop.

Harsh Verma · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.