Skip to content

Category

small language model

3,468 papers

#artificial intelligence Preprint Sep 2026

SQUARE: Structured Quantum Representation Adapters as Compact Quadratic Feature Maps for Frozen Language Models

Frozen language models (LMs) are increasingly used as fixed feature extractors for downstream reranking, scoring, and preference modeling, raising a practical question: how should a compact module represent interactions among features in a fixed low-dimensional bottleneck? Common linear and low-rank adapters remain lin...

E. Roh, Hyojun Ahn, Hoyeong Lee et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Controlled Decoding Attacks on Black-Box LLMs

This work introduces \method{}, a framework for jailbreaking through text-only continuation interfaces that permit repeated sampling and assistant-prefix continuation, and achieves the highest mean score most comparisons against baselines.

Jesson Wang, Shawn Li, Wei Yang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Safer Content or Firmer Refusals? A Hybrid Perturbation Defense for Alignment under Harmful Fine-tuning

This work proposes VaccineBooster, a single alignment procedure that combines embedding perturbation and weight-level gradient attenuation within each training step, and indicates a trade-off: embedding perturbation primarily reduces flagged harmful content, whereas gradient attenuation primarily preserves explicit ref...

M. Akram, Mufid Kamel Marican, Anvesh Reddy Yenugu et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Spotter: Let the Embodied Model Lead, and the VLM Reflect for It

Spotter is proposed, which reverses the roles: the embodied model leads and executes continuously, while the VLM runs in parallel, monitors through a lightweight local screener, intervenes only when an error is detected, reflects on and corrects it, and returns control.

Long Li, Qi-Chao Zhao, Yue Yang et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Large-scale factor analysis shows machine intelligence is only partially interpretable

The findings go against current endeavors of defining, identifying, and targeting general intelligence as a tangible construct in language model development, since the strategy of targeting a single conceptual ability without support is left without support.

Faiz Ghifari Haznitrama, Afrizal Hasbi Azizy, Faeyza Rishad Ardi · 0 citations
#artificial intelligence Preprint Sep 2026

Similar Choices, Different Attention: Cross-Modal Associations in Humans and Vision-Language Models

Cross-modal associations are systematic pairings of features across modalities, such as the association of'bouba'with round shapes and'kiki'with sharp shapes. Prior work has compared humans and vision-language models (VLMs) on such associations, but often using different stimuli or tasks between humans and models. Here...

Su-Min Hong, Katsumi Ibaraki, Renee Shi et al. · 0 citations
#artificial intelligence Review Sep 2026

Calibrated to Whom? Persona and Language Effects on Cultural Values in JEV

Decision-only language models return a probability for every answer option instead of generating text, which makes them attractive as survey respondents and as judges. We audit the cultural values of one such model, TypeSafe's JEV, with the Values Survey Module 2013. We asked it the 24 items as 12 matched Saudi and 12...

Bushra Asseri, Abdulaziz M. Asseri · 0 citations
#artificial intelligence Preprint Sep 2026

AerialDojo-200K: A Large-Scale Benchmark Suite for Open-World Aerial Object-Goal Search

A large-scale benchmark suite for open-world aerial object-goal search, with 3 times as many scenes and 18.7 times as many task instances as the largest existing benchmark for this task, and a unified evaluation framework with a unified evaluation framework.

Tong-Tong Feng, Xin Wang, Hao-Ran Hou et al. · 0 citations
#artificial intelligence Preprint Sep 2026

AdviSD: Learning to Advise Frontier LLMs via Targeted Multi-Turn Self-Distillation

The method, Advisor Self-Distillation (AdviSD), pairs outcome-based reinforcement learning with self-distillation from a feedback-conditioned copy of the advisor selectively, and beats matched-count random selection, supporting the value of its selection rule.

Rishabh Agrawal, He-Jie Cui, Sha-Sha Li et al. · 0 citations
#artificial intelligence Preprint Sep 2026

HARISSA: Inference-Time Self-Checks for Efficient and Safe Local Language Model Deployment

HARISSA fine-tunes the model so that both states predict correctness, then makes both decisions with one policy that cascades through the ways of answering from cheapest to most expensive, skipping a way the prefill state predicts will fail and deferring the query when the answer it stops with is predicted wrong.

Kenan Alkiek, Moontae Lee, David Jurgens et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Cross-Entropy Guided Routing in Mixture-of-Experts Large Language Models

This work introduces token-error supervision for sparse routing in two forms, one of which directly aligns the router's affinities to the model's objective without requiring an additional head or inference-time modification and both mechanisms preserve the native sparse execution budget and aggregation policy.

Yury Nahshan, Nati Daniel, Jacob Goldberger et al. · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.