Skip to content

Category

machine learning

17,191 papers

#artificial intelligence Preprint Open access Oct 2026

Expert-Guided Rubrics as Dense Reward Signals for Reinforcement Learning in Non-Verifiable Domains

Large language models (LLMs) are increasingly deployed as autonomous agents in non-verifiable domains such as financial services, where they must interpret user intent, rewrite queries, and retrieve information under domain-specific constraints. Although reinforcement learning (RL) can train such agents from the conseq...

Ashish Bansal, Hossam Amer, Keerat Kaur Guliani et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Steerable Pluralistic Policy Alignment from Anonymized Crowd Feedback

Pluralistic alignment requires AI systems to learn from diverse populations whose preferences may reflect heterogeneous or even conflicting objectives, and to personalize their behavior to individual users. Existing approaches in pluralistic alignment often assume access to annotator identities and rely on powerful pre...

Akansha Kalra, Ellen R. Novoseller, Vernon J. Lawhern et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Adaptive Multi-Token Prediction: How far should we go?

Multi-token prediction (MTP) can accelerate language-model decoding by drafting several tokens and verifying them in a single target-model pass. However, the best speculation horizon changes with context: longer drafts offer greater amortization when reliable, but can waste compute on suffixes discarded after a rejecti...

E. Anand, M. Parwani, Xin-Yuan Cao · 0 citations
#artificial intelligence Preprint Oct 2026

Evolving Semantic Indexes for Generative Retrieval

Generative retrieval (GR) casts search and recommendation as autoregressive generation of discrete semantic identifiers (SIDs). SID design largely determines GR quality, but its discrete, interdependent components (SID construction, collision handling, decoding, and training) cannot be optimized end-to-end with gradien...

Jinming Nian, Jyun-Yu Jiang, Henry Tsai et al. · 0 citations
#artificial intelligence Preprint Oct 2026

OptScientist: Automated Discovery of Optimization Laws

Many scientific phenomena are best understood as outcomes of underlying optimization problems, yet automated scientific discovery has largely focused on recovering equations that describe observed input-output patterns. We introduce OptScientist, a novel automated framework for discovering compact symbolic optimization...

Zhenyao Ma, Yue-Yue Liang, Jian-Qiao Zhu · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Building Telecom Language Models with RSOD: Domain Data, Specialist Post-Training, Memory-Conscious Distillation, and Networking Evaluation

Telecom language models must combine broad networking knowledge with specialist behavior across routing, broadband services, access technologies, and operational diagnostics while remaining practical to deploy as a single model. We present an end-to-end framework that builds source-grounded synthetic training data from...

Anil Srirangapatna Nagesh, Nitin Gupta, Anuj Taneja et al. · 0 citations
#artificial intelligence Preprint Open access Oct 2026

Lost in Recovery: Demystifying Recovery Behavior of Computer-Use Agents via Goal-Oriented Action Replay

Recent advances in large (vision) language models have enabled computer-use agents that automate digital workflows via fine-grained keyboard and mouse operations. However, such agents remain fragile in long-horizon settings, where errors accumulate and executed actions leave unintended side effects, making the ability...

Byeonghun Bang, Sangwoo Park, Jinheon Baek et al. · 0 citations
#artificial intelligence Preprint Oct 2026

SAPD: Learning from Agent Experience without Environment Interaction

Step-Advantage Policy Distillation (SAPD) is proposed, a method for learning from offline trajectories using relative step advantages, allowing the student to generate responses conditioned on recorded histories, and introduces relative step advantage signals to stabilize training.

Jun-Cheng Diao, Hai-Bin Wang, Wei Shi et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Give the Model a Finger: Developmentally Aligned Evaluation of Counting in Vision-Language Models

Vision-language models (VLMs) are exact on small sets and drift into estimation on larger ones, a profile reminiscent of children before they master counting. Children cross the barrier with epistemic actions: pointing at each item while reciting number words, moving counted items aside, partitioning the array. We give...

Ying-Xin Jia, Hui Geng, Wen-Xin Yang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

When Does Experience Memory Help Closed-Loop LLM Driving Agents? A Controlled Evaluation with Resampled Warmup Pools, Token-Matched Fillers, and Audited Baselines

This work treats the warmup pool as a resampled random factor and adds token-matched irrelevant-filler controls, oracle-certified diagnostics, caution-pricing metrics, and quantified audits of the baseline ports to answer the question when does experience memory help a closed-loop LLM driving agent.

Ying-Xin Jia, Xuan-Yi Li · 0 citations
#artificial intelligence Preprint Oct 2026

Inferring continuous cognitive traits from limited neuroimaging data using pairwise convolutional neural networks

P pairwise convolutional ranking framework is introduced that learns directly from whole-brain T1-weighted MRI by making comparative rather than absolute predictions, which performs well even with small samples (N=108).

Marjan Rashidi, Robert Bain, Craig E. L. Stark et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Nov 3, 2026

Learn the rules: The hacker mindset

Research Manager Mike Walker reflects on a career spanning hacker culture, cybersecurity, and AI, sharing lessons about trust, teamwork, leadership, and why solving difficult problems requires curiosity, judgment, agility—and an understanding of the rules. The post Learn the rules: The hacker mindset appeared first on Microsoft Research.

Google DeepMind Blog Nov 3, 2026

Agentic cheminformatics with Google Antigravity

Learn how Google Antigravity and our Cheminformatics Skills accelerate drug discovery workflows, search compounds, and propose novel rigidified macrocycles.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.