Skip to content

Category

small language model

3,629 papers

#small language model Open access Sep 2026

A Framework for Pluralistic Value Assessment (MindOrder)

We present a computational framework for multi‑dimensional value assessment, designed to address a structural problem shared by historical evaluation and AI value alignment: how to adjudicate among incommensurable values without collapsing them into a single score. Mainstream approaches to value aggregation seek a corr...

Wei Wan · 0 citations
#small language model Open access Sep 2026

GQLSA: Grouped-Query Latent Sparse Attention: A Hardware-Native Architecture for Efficient and Effective Sequence Modeling

We introduce Grouped-Query Latent Sparse Attention (GQLSA), a novel attention mechanism that integrates latent compression, grouped-query sharing, and block-sparse attention into a unified hardware-native architecture. GQLSA achieves linear O(T) complexity in sequence length, a 3.8x speedup over multi-head attention at...

Fardin Sabid · 0 citations
#generative ai Open access Sep 2026

PREreview of "Training Large Language Models for Small-Molecule Design with Synthetic Task Scaling"

This Zenodo record is a permanently preserved version of a PREreview. You can view the complete PREreview at https://prereview.org/reviews/22662611. Review of "Training Large Language Models for Small-Molecule Design with Synthetic Task Scaling" Summary This preprint asks whether LLMs can be post-trained for expensive,...

Sneh Pankajbhai Vora · 0 citations
#large language models Open access Sep 2026

Retrieval-Augmented Generation for Question Answering over a Research Paper: A Hybrid Dense-Keyword Retrieval Study on the Transformer Architecture Paper

Retrieval-Augmented Generation (RAG) combines information retrieval with language generation to improve the grounding of generated answers in a source document, addressing a central weakness of purely parametric large language models: the tendency to produce fluent but unsupported statements. This study designs, implem...

Dileep Choudhary · 0 citations
#small language model Open access Sep 2026

In RAG We Trust? Measuring Robustness of Retrieval-Augmented Generation Under Document Poisoning

Retrieval-augmented generation (RAG) grounds a language model in retrieved documents, which reduces hallucination but creates a new attack surface: if retrieved text is tampered with, the model may repeat the falsehood. We study how much a small quantized model, Llama 3.1 8B, degrades when a fraction of its retrieved c...

Iliano Fasolino · 0 citations
#small language model Open access Sep 2026

Toledo — Equation Library of the Human–AI Readout Programme (v1.6.0): Information Discrete Mathematics as root extension R2, resistance ladder with reproduction evidence, 1,267 coded entries, MCP server, static API, website, catalogue

v1.8.0 (2026-09-08). Version DOI: recorded once minted (concept 10.5281/zenodo.22537318). Commits `d786116`/`8954bcf` (Religious Attribution Non-Collapse), `8be7433`/`ef3adc7`/`270c2af` (executable-equations registrar review), `cb03ab6` (Internal-Consistency ladder + mechanical clearing fixes), `fd57ffd` (consistency-g...

Yaoharee Lahtee · 13 citations
#natural language process... Preprint Sep 2026

Q2D-Web: A Large-Scale Benchmark for Retrieval in Agentic RAG Systems

Q2D-Web is introduced, a large-scale agentic retrieval benchmark consisting of a 190M-document web corpus and 70k agentic search queries in ten languages, reformulated from real-world user queries in production systems, and benchmark 13 retrievers including lexical, dense, and late-interaction models.

Maximilian Schall, Sedigheh Eslami, Markus Krimmel et al. · 0 citations
#computer vision Preprint Sep 2026

From Coordinates to Candidate Regions: Temporal Change Localization via Region Selection in Remote Sensing Multimodal LLMs

This work presents an RS-specific formulation of the region selection paradigm, previously explored in natural-image MLLMs, and extends it to temporal change localization over multi-image sequences, and constructs a multi-task training and evaluation suite spanning localization, referring expression, visual grounding,...

J. Chung, Sungjune Park, Yeongyun Kim et al. · 0 citations
#natural language process... Preprint Sep 2026

Which Forms of Caregiver Feedback Support Grammar Learning? A Reinforcement-Learning Study of Child-Like Language Models

Social interaction is central to children's language learning, but the effects of different forms of caregiver feedback are difficult to isolate in naturalistic data. We use child-like language models as controlled learners to test which forms of feedback support grammatical development. Small GPT-2-style models are pr...

Jing Liu, Marianne Schweitzer, Abdellah Fourtassi · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.