Skip to content

Category

machine learning

17,191 papers

#artificial intelligence Preprint Open access Oct 2026

Controlled Evaluation of EEG Foundation Models: Random Initialisation, Band-Power and Validation-Selected Probes

EEG foundation models report downstream gains, yet their protocols seldom include three controls. These are the same encoder untrained, spectral features fitted on the same data, and a layer picked without looking at test scores. We therefore evaluate five publicly released EEG foundation models and an in-house JEPA-st...

Mingyu Jeon, Suwan Cho, Jae Young Suh · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Concept Acupuncturist: An Efficient and Precise Concept Erasure Method for Diffusion Models via Sparse Autoencoders

Diffusion-based image generation models produce high-quality images but may generate harmful or policy-violating content, motivating machine unlearning (MU) to selectively remove target concepts while preserving general capabilities. However, existing MU approaches often struggle with the distributed and entangled natu...

Yiran Xiahou, Siliang Qin, Kai Chen et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Rethinking Representation Geometry in Supervised Contrastive Learning under Long-Tailed Data

Supervised contrastive learning and its balanced variants have demonstrated their effectiveness for representation learning under long-tailed distributions. However, although prior analyses suggest that their optimal representations may exhibit a regular simplex geometry, whether such a geometry is indeed exhibited rem...

Joonhyeok Jeong, Jy-yong Sohn, Kibok Lee · 0 citations
#artificial intelligence Preprint Open access Oct 2026

A Mathematical Theory of the Jacobian Lens

Recent work from Anthropic introduced a new interpretability tool, called the Jacobian lens (J-lens, Gurnee et al., 2026). This method identified linear directions in the hidden states of frontier language models that had properties reminiscent of working memory-like representations. However, it is unclear what mechani...

Mitchell Ostrow, Daoyuan Qian, Toni Liu et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

RobustNCL: Robustifying Neuromorphic Continual Learning under Transient Faults with Lightweight Detect-and-Cure Strategy

In neural networks, continual learning (CL) is a prominent approach for enabling deployed systems to adapt to dynamic operational environments by effectively learning from new unseen data at runtime. Recently, the neuromorphic continual learning (NCL) concept has emerged as an energy-efficient alternative to CL by leve...

Rachmad Vidya Wicaksana Putra, Shuochen Zhou, Muhammad Shafique · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Kolibri: A Sovereign European Model on the Pareto Frontier

This report introduces Kolibri, an English-German mixture-of-experts transformer with 78.1B total parameters and 3.46B active parameters per token, released as open weights under the Apache 2.0 licence. We built Kolibri for sovereign and specialised deployment, with a particular focus on German and on regulated domains...

Aleph Alpha, :, Moritz Althaus et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

ENCL: Enabling Efficient Neuromorphic Continual Learning with Local Learning Rule and Sub-Network Freezing Strategy

Continual learning (CL) in neural networks is a promising learning approach for updating the knowledge of deployed systems based on new data encountered at run time, that have not been learned during the offline training phase. To enable their power/energy-efficient CL processing, neuromorphic continual learning (NCL)...

Rachmad Vidya Wicaksana Putra, Shuochen Zhou, Hassan Raza et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Learning Structured Sparsity for Large Models: Bridging Model Compressibility and Efficient Inference

Scaling laws continue to reward increases in model scale, while the resulting computational and memory demands drive greater reliance on cloud infrastructure for inference. Yet unreliable network connectivity, communication delays, and privacy requirements can make such reliance impractical, motivating local execution...

Tian-Xiang Xia, Li-On Kai, Niao He et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Effectiveness of Curriculum Learning Depends on Reward Sparsity and Competing Optima

While animals and people tend to learn a task more quickly and reliably when they first train on simpler versions of it, curriculum learning's effectiveness in artificial settings varies, and appears substantially greater in reinforcement learning than in supervised learning. In this work, we construct and analyze a mi...

John J. Vastola, Ann C. Huang, S. H. Singh et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Rethinking Multi-View Fusion for Urban Representation Learning

Urban region representation learning encodes heterogeneous urban signals, such as mobility flows, points of interest, and land-use patterns, into unified embeddings for downstream tasks, including check-in prediction, crime forecasting, and service demand estimation. Existing approaches rely on globally shared fusion a...

Sean Bin Yang, Zongyi Xu, Jilin Hu et al. · 0 citations
#artificial intelligence Open access Oct 2026

SEVI: Safe Evidential Real-World Reinforcement Learning

Safe Evidential Real-World Reinforcement Learning (SEVI), a framework for reliability-aware safety intervention during real-world policy learning, is proposed and an Evidential Safety Critic is introduced that estimates both future constraint-violation risk and epistemic uncertainty in a single forward pass.

S. M. Shithil, Lan-Tao Liu · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Benchmarks Are Surprisingly Compaction-Friendly

Long horizon agentic tasks are now pushing LLM agents past their context window. To continue the task, the agent scaffold has to free up the context window, a process known as context compaction. Compaction is generally lossy by design: agents can silently lose task constraints, instructions, or their reasoning behind...

Jeanne Salle, Hardik Bhatnagar, Matthias Bethge et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.