Skip to content

Category

small language model

813 papers

#small language model Preprint Aug 2026

FormuEvo: LLM-Guided Evolution for Discovering Solver-Efficient Mixed-Integer Programming Formulations

A solver-informed diagnosis mechanism that exploits fine-grained solver statistics as verbal gradients for targeted refinement and a structured memory abstracts prior experience into reusable modeling strategies, avoiding redundant exploration while enabling zero-shot transfer to unseen problems and bootstrapping smaller LLMs.

Haofeng Yuan, Ji-Ming Peng, Jieyi Bi et al. · 0 citations
#small language model Preprint Aug 2026

A Reproducible, License-Aware Distillation Recipe for CPUDeployable Safety Classification

A reproducible, license-aware knowledge-distillation recipe addressing the constraint of deploying a safety layer for large language models on commodity hardware by partitioning the corpus into seven safety categories aligned to a public hazard taxonomy.

Edson Rodrigues da Cruz Filho, Paulo Ricardo Ferreira Neves, P. H. Falsetti et al. · 0 citations
#small language model Preprint Aug 2026

From Subjective Judgments to Auditable Standards:Protocol-Guided AI Auditing of Website Redundancy

Website redundancy does not have a single fixed meaning. The same repeated element may distract during one task and provide backup during another. We introduce CORA (Counterfactual, Observable Redundancy Audit), which measures repetition load, normal-use tax, and failure-domain recovery reserve separately. Each run retains screenshots, stable element identities, and task traces. A versioned vision-language model proposes the annotations. Typed validation and release checks then determine whether a calibrated dimension can be reported; failed or malformed outputs stay in the fixed denominator. On a transparent mechanistic testbed, the factorized CORA representation separated reserve from normal-use tax and predicted perturbed success more accurately than scalar-load baselines. The model studies then showed why repeatability is not enough: two small local vision-language models produced recurring outputs, but neither instrument met all release requirements. CORA therefore withheld automated scores from both instruments while retaining the raw responses and failure records. Separate checker fixtures confirmed that the typed validator and hardened release gates implement their specifications; these tests do not establish semantic grounding or accuracy on production sites. Taken together, the results position CORA as an auditable candidate procedure for the controlled benchmark studied here rather than a general standard. Human agreement, AI-versus-human accuracy, and validation on independent production sites remain open empirical questions.

G. Kong, Yongtong Cao · 0 citations
#small language model Preprint Aug 2026

Decoupled Physical Modeling and Execution for Physics Reasoning

A unified framework is introduced that distills intermediate representations that explicitly encode the physical modeling process and adopt a two-stage post-training strategy, where supervised fine-tuning establishes structured modeling, and reinforcement learning with rubric-based feedback improves the quality of the modeling process.

Ye Zhang, Xuehang Guo, Rui Pan et al. · 0 citations
#small language model Preprint Aug 2026

PUMA: A Polish Benchmark for Culturally Grounded Multimodal Understanding

PUMA (Polish Unified Multimodal Assessment) is proposed, a novel benchmark of 900 hand-crafted tasks designed to probe the limits of multimodal models in the Polish cultural and linguistic context and open-source the evaluation framework to advance localized multimodal AI research.

Slawomir Dadas, Michał Perełkiewicz, Rafal Poswiata et al. · 0 citations
#small language model Preprint Aug 2026

What actually runs: a measurement study of language model placement and decode speed on the Apple Neural Engine

This work sweeps a 64-shape matrix of LLM primitives that varies how a computation is expressed while holding what it computes fixed, recording per-operation device support and finds that placement is a property of how a computation is expressed, not of what it computes.

A. ShahirM · 0 citations
#small language model Preprint Aug 2026

Monitored free fermions under periodic driving

We investigate analytically and numerically a one-dimensional periodically driven free-fermionic system subjected to monitoring of the local particle density. Based on the analytical approach that describes the long-wavelength physics of the time-dependent Hamiltonian in the field-theoretical language using the nonlinear sigma-model (NLSM), we reveal that driving does not alter the universality class of the problem. As a consequence, the system retains the area-law behavior in the thermodynamic limit, with an intermediate diffusive regime giving rise to logarithmic growth of entanglement entropy for a small monitoring rate. At the same time, driving leads to a renormalization of the bare coupling constant of the NLSM, which controls the space-time ``conductivity''in the diffusive regime. We derive the analytic form of this renormalization, which becomes particularly strong in the case of a ``maximally symmetric''drive and sufficiently short driving period. In addition, we employ the Wiener-Hopf method to investigate the ballistic-diffusive crossover. These analytical predictions are corroborated by numerical simulations of the von-Neumann entanglement entropy and the density correlation function. Our numerical results clearly demonstrate that, with an increase in the system size, there are successive crossovers from ballistic to diffusive behavior and ultimately to localization. Furthermore, in the diffusive regime, we observe weak-localization corrections that are in agreement with the analytical predictions of the NLSM. Overall, our results provide a unified analytical and numerical framework for understanding the effects of monitoring in time-modulated fermionic systems, paving a way for broader investigations of driven quantum matter.

Aditi Chakrabarty, A. Mirlin, I. Poboiko · 0 citations

ProphDR: An Interpretable Deep Learning Model for Predicting Cancer Drug Response via Multi-Omics and Cross-Attention Mechanisms

ProphDR is an interpretable deep learning framework that integrates multiomics data and drug structural information using a hierarchical attention mechanism, and generates biologically interpretable attention maps that highlight key pharmacophores and resistance-related genes consistent with established mechanisms in NSCLC and BRCA.

Yundian Zeng, Qing Ye, Jike Wang et al. · 0 citations

From tech blogs

See all →

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.