Skip to content

Category

machine learning

17,191 papers

#artificial intelligence Preprint Open access Oct 2026

Symmetry-Compatible Principle for Optimizer Design: Embeddings, LM Heads, SwiGLU MLPs, and MoE Routers

A striking geometric disparity has long persisted in the practice of deep learning. While modern neural network architectures naturally exhibit rich symmetry and equivariance properties, popular optimizers such as Adam and its variants operate inherently coordinate-wise, rendering them unable to respect the equivarianc...

Tim Tsz-Kit Lau, Weijie Su · 0 citations

Attention Transfer Is Not Universally Effective for Vision Transformers

A comprehensive benchmark of 20 teachers from 11 well-known ViT families reveals that Attention Transfer is not universally effective, and identifies architectural mismatch between the pre-trained teacher and the standard student as the primary mechanism.

Huai-Yuan Qin, Mu-Li Yang, Gabriel James Goenawan et al. · 3 citations
#machine learning Preprint Open access Oct 2026

Topology-Aware Representation Alignment for Semi-Supervised Vision-Language Learning

Vision-language models have shown strong performance, but they often generalize poorly to specialized domains. While semi-supervised vision-language learning mitigates this limitation by leveraging a small set of labeled image-text pairs together with abundant unlabeled images, existing methods remain fundamentally pai...

Junwon You, Mihyun Jang, Sangwoo Mo et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Dictionary learning for Kernel EDMD

Studying nonlinear dynamical systems through their state space behavior can be challenging, and one possible alternative is to analyze them via their associated Koopman operator. This turns the nonlinear problem into a linear, infinite-dimensional one. To approximate the operator in finite dimensions, extended dynamic...

Erik Lien Bolager, Boumediene Hamzi, Houman Owhadi et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Ideological Bias in LLMs' Economic Causal Reasoning

Do large language models (LLMs) exhibit systematic ideological bias when reasoning about economic causal effects? As LLMs are increasingly used in policy analysis and economic reporting, where directionally correct causal judgments are essential, this question has direct practical stakes. We present a systematic evalua...

Donggyu Lee, Hyeok Yun, Jungwon Kim et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Scaling Human-AI Coding Collaboration Requires a Governable Consensus Layer

Vibe coding turns natural-language intent into working software, but code generation alone does not give humans and agents a shared account of what they are building. As collaboration spans participants, components, and releases, design choices must remain understandable and open to revision. We argue that scaling huma...

Tianfu Wang, Zhezheng Hao, Yin Wu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

StaRPO: Stability-Augmented Reinforcement Policy Optimization

Reinforcement learning (RL) is effective in enhancing the accuracy of large language models in complex reasoning tasks. Existing RL policy optimization frameworks rely on final-answer correctness as feedback signals and rarely capture the internal logical structure of the reasoning process. Consequently, the models wou...

Jinghan Zhang, Fengran Mo, Tharindu Cyril Weerasooriya et al. · 0 citations
#machine learning Preprint Open access Oct 2026

Sharp Statistical Thresholds for Attributed Gaussian Graph Matching

We investigate the problem of matching networks where both edge weights and node features are correlated following a specific node correspondence. While prior work has established sharp thresholds for matching either graphs or features individually, the joint setting has been significantly less explored. In this study,...

Mohammad Hassan Ahmad Yarandi, Luca Ganassali · 0 citations
#artificial intelligence Preprint Open access Oct 2026

The Reasoning Trap -- Logical Reasoning as a Mechanistic Pathway to Situational Awareness

Situational awareness, the capacity of an AI system to recognize its own nature, understand its training and deployment context, and reason strategically about its circumstances, is widely considered among the most dangerous emergent capabilities in advanced AI systems. Separately, a growing research effort seeks to im...

Subramanyam Sahoo, Aman Chadha, Vinija Jain et al. · 0 citations

Flow Matching with Uncertainty Quantification and Guidance

Uncertainty-aware flow matching (UA-Flow) is proposed, a lightweight extension of flow matching that predicts the velocity field together with heteroscedastic uncertainty that tracks sample fidelity more consistently than element-wise baselines and that these signals also carry information about data-manifold support.

Juyeop Han, Lukas Lao Beyer, Sertac Karaman · 8 citations

Is Flow Matching Just Trajectory Replay for Sequential Data?

This work derives the optimal velocity field targeted by the empirical FM objective on sequential data and shows that the resulting sampler is an ODE whose dynamics describe a nonparametric, memory-augmented continuous-time dynamical system.

Soon Hoe Lim, Shi-Zhen Lin, Michael W. Mahoney et al. · 4 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.