Skip to content

Category

machine learning

17,191 papers

#machine learning Preprint Open access Oct 2026

Poisoning-Based Backdoors Are Not Cryptographic

Defending against a backdoor requires recovering the verifier that decides whether an input is a trigger, since blocking individual triggers fails against an attacker who can generate new ones. If a verifier could be installed with the asymmetry of cryptographic authentication, where only the attacker can produce trigg...

Masahiro Kaneko · 0 citations
#machine learning Preprint Open access Oct 2026

NADS: Navigator-Guided Data Selection for Mitigating Catastrophic Forgetting in Fine-Tuning

Catastrophic forgetting is a central obstacle in single-stage fine-tuning of large language models (LLMs) on a new task, especially when the original pretraining data are unavailable. Synthetic data offers a practical mitigation path, but candidate pools are often noisy and redundant, making effective selection essenti...

Jianhao Zhang, Ou Wu, Yi Du · 0 citations
#machine learning Preprint Open access Oct 2026

Generative Retrieval for Reverse Target Fishing with a Proteome-Scale Benchmark

Reverse target fishing identifies protein targets for a query molecule and is central to drug discovery and repurposing. Discriminative approaches adapted from virtual screening face sparse, long-tailed associations and missing-not-at-random measurements: treating unrecorded pairs as negatives can suppress genuine targ...

Zhichao Deng, Haichuan Tan, Xin Hong et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Learning Discrete Riemannian Metrics for Physical Fields with Cochain-Frame Equivariance

Physical fields on meshes require a separation between topology and geometry: differential identities should remain exact, while geometry, material response, and anisotropic coupling are learned from data. Existing neural surrogates often mix these roles inside unconstrained message passing. We introduce Riemannian Hod...

Dongzhe Zheng, Christine Allen-Blanchette · 0 citations
#machine learning Preprint Open access Oct 2026

How Far Can Sharpness and Complexity Jointly Explain Generalization?

Large-scale empirical studies have revealed that many widely used generalization measures correlate only weakly with generalization, suggesting that relying on a single factor is insufficient to explain it. In this work, we examine sharpness and complexity jointly, placing the reach of the two-factor view at the center...

Ziyu Cheng, Xitong Zhang, Longxiu Huang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

SDS-LoRA: Overcoming Anisotropic Gradient Scaling in Low-Rank Adaptation

Low-Rank Adaptation (LoRA) enables efficient adaptation of large pretrained models to downstream tasks by parameterizing weight updates with low-rank matrices. In this paper, we investigate the limitations of the LoRA parameterization from a geometric perspective. Specifically, we show that when a full fine-tuning grad...

Junghun Oh, Sungyong Baik, Kyoung Mu Lee · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Behavioral Consistency in Machine Learning

A trained model is usually described by its weights, as if the weights fixed its behavior. In practice the same weights are run by different programs. Training uses high-precision accumulation and fixed tensor shapes, while serving uses low-precision arithmetic, fused attention kernels, a paged key-value cache, and dyn...

Lan Wu, Bruce Changlong Xu · 0 citations
#machine learning Preprint Open access Oct 2026

Measuring Model Robustness via Fisher Information: Spectral Bounds, Theoretical Guarantees, and Practical Algorithms

The robustness of deep neural networks is crucial for safety-critical deployments, yet existing evaluation methods are often attack-dependent and lack interpretability. We propose a principled, attack-agnostic robustness metric based on the spectral norm of the Fisher Information Matrix (FIM), which quantifies the wors...

Chong Zhang, Xiang Li, Jia Wang et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Rethinking Molecular Text Representations for LLMs: An Empirical Study

Large language models (LLMs) are increasingly used for molecular tasks, but it remains unclear which molecular representation to use. We present a systematic benchmark, MolRepBench, to evaluate LLM molecular competence across nine representations and eight chemical tasks. We benchmark 16 LLMs across five model families...

Arun Raja, Garrett M. Morris, Kian Ming A. Chai · 0 citations
#machine learning Preprint Open access Oct 2026

LSVD: Loss-Aware Low-Rank Approximation for Efficient Low-Precision Vision-Language Models

Vision-language models (VLMs) deliver strong multimodal reasoning capabilities, but their large computational cost and high parameter counts make deployment challenging on resource-constrained devices. Low-rank decomposition has emerged as a promising compression technique, yet existing methods often optimize local mat...

Haiyu Wang, Yutong Wang, Leshu Li et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Measuring, Localizing, and Reducing the AI-Like Writing Style of Post-Trained LLMs

Post-trained language models often exhibit a recognizable AI-like writing style, yet its connection to post-training and internal representations remains poorly understood. In this work, we study whether post-training introduces or amplifies AI-like stylistic regularities and whether these regularities have a localized...

Aniket Anand, Janvijay Singh, Zhewei Sun et al. · 0 citations
#machine learning Preprint Open access Oct 2026

SoundnessBench: Can Your AI Scientist Really Tell Good Research Ideas from Bad Ones?

Autonomous AI research agents aim to speed up scientific discovery by automating the research pipeline from hypothesis generation to peer review. However, existing benchmarks rarely test a fundamental bottleneck whether LLMs can judge the methodological viability of a research idea $\textbf{before}$ investing time and...

Sy-Tuyen Ho, Minghui Liu, Huy Nghiem et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.