Skip to content

Category

machine learning

17,191 papers

#machine learning Preprint Open access Oct 2026

Where's the Indirect Evidence? Investigating Grammatical Generalization with Influence Functions

Language models generalize beyond their training corpus to learn linguistic phenomena (Patil et al., 2024; Misra and Mahowald, 2024), showing that there exists indirect evidence driving learning. Prior work has inferred that indirect evidence exists without identifying its character or considered specific hypotheses ab...

William Dai, Zhenghao Herbert Zhou, Maya Viswanathan et al. · 0 citations
#machine learning Review Oct 2026

FederatedBytes: Tokenizer-Free, Byte-Level Small Language Models for Efficient Multimodal Federated Learning

Federated Learning (FL) is a powerful machine learning framework that allows building a global model from the contributions of multiple, distributed clients, while ensuring the privacy of their local data. However, its heavy computational and communication overheads challenge its use for contemporary AI workloads such...

Ali Sarabadani, Massimo Piccardi, M. Abolhasan et al. · 0 citations
#artificial intelligence Preprint Oct 2026

When to Forget: Risk-Controlled Context Adaptation for Long-Horizon Agents

Long-horizon agents learn from failure, but the value of a failure record can change as execution progresses. We study when retaining, compressing, or removing the same history block improves subsequent execution relative to full-history KEEP. We introduce RECAP, a framework that combines matched context interventions,...

Chen-Leng Chen, Yang-Bo Wei, Zhi-Jie Zheng et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

ToPA: Block-wise Toeplitz Adaptation for Expressive and Efficient Fine-Tuning

Parameter-Efficient Fine-Tuning (PEFT) has emerged as a prevalent strategy for adapting large pre-trained models. Among PEFT techniques, reparameterization-based methods, particularly those that employ low-rank or sparsity structures, have attracted significant attention. However, these approaches often underperform fu...

Sicong Li, Qianqian Xu, Zhiyong Yang et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Causal Edit Serialization

Standard autoregressive language models generate text sequentially, but revision requires referring back to tokens in the input context or those already generated. Causal Edit Serialization (CES) is introduced as a framework for expressing such revisions within the same causal token stream. Special pointer tokens are p...

Louis Robinson · 0 citations
#machine learning Preprint Open access Oct 2026

Replay Pruning and Few-Bit Integer Inference for Hardware-Efficient Speed-Sign Recognition

Speed-limit sign recognition on an automotive camera system-on-chip (SoC) must fit a detector and a classifier (the reader) into the memory, arithmetic, and energy budgets of the device. In our two-stage recognizer, the detector, a YOLO-family network with ReLU and hard-sigmoid operators, is compressed by channel repla...

Se Un Park, Kyungkeon Chung, Huigeol Kim et al. · 0 citations
#machine learning Preprint Oct 2026

Reasoning Reranking with Semantic IDs as the Sole Item Representation

Reasoning rerankers write a rationale before ranking a candidate slate, and existing systems read item metadata to do so, even though generative recommenders increasingly represent items as compact Semantic IDs (SIDs). Ranking from SIDs alone has two appeals: SID prompts are far shorter than the matched item text, and...

Zhenwei Tang, Jin-Tao Liu, Di Bai et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Anytime Contracts for AI Services

AI services are prone to moral hazard, as model providers can silently route requests to cheaper, lower-quality models, and the inherent stochasticity of model outputs makes this degradation hard to detect. Contract theory addresses moral hazard by designing payment rules that reward high-quality outputs and prevent st...

Boris Velasevic, Eden Saig, Eric Mazumdar · 0 citations
#machine learning Preprint Open access Oct 2026

Unit-level aggregation breaks coverage in causal foundation models

Causal foundation models (CFMs) show promising results for treatment-effect estimation, with unit-level estimates that are competitive on standard benchmarks. Many causal analyses, however, inform decisions through effects averaged over groups of units, such as the full sample, the treated units, or a subgroup, and for...

Gabe Schulman, Lucius E. J. Bynum, Yoav Wald · 0 citations
#machine learning Preprint Open access Oct 2026

One Communicator, Three Vendors: Extending the MoA Predictive Theory to a Real NVIDIA+AMD+CPU MPI Ensemble

The companion MPI-extension paper validated the first communication-bearing machine-shape ensemble: four NVIDIA A100 ranks and four CPU ranks on one NCSA Delta node under one Open MPI job, reassembled by MPI_Gatherv. This paper extends it to a multi-vendor communicator. A Slurm heterogeneous job spanning Delta's A100 a...

Lenore Mullin, Gaetan Hains · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.