Skip to content

Category

machine learning

4,920 papers

#machine learning Preprint Aug 2026

Normalized Low-Rank Adaptation

Normalized Low-Rank Adaptation (NoRA) is introduced, a simple yet effective method that normalizes the down-projection matrices during training, improving standard LoRA without requiring repeated normalization throughout training.

Jiale Kang, Zi-Yin Yue, Zheng Zhan et al. · 0 citations
#machine learning Preprint Aug 2026

Language-Informed Flow Matching for Trend-Guided Structure-Based 3D Molecular Generation

LiFT, a language-informed cross-modal framework built on Flow Matching for trend-guided 3D molecular generation across both de novo design and scaffold hopping, and suggests that language-derived chemical priors provide effective trend-level guidance for 3D molecular generation.

Tian-Yu Gao, Zhi-Kai Su, Jia-Shu Li et al. · 0 citations
#machine learning Preprint Aug 2026

Controlling Refusal Behavior of LLMs via Stiefel-Constrained Rotation Steering

This work develops a self-contained methodology for learning parameter-efficient rotational transformations based on Riemannian optimization and empirically validate the proposed rotation-based steering scheme, demonstrating its superiority in intervention efficiency.

Kirill Bunin, Dmitry Bylinkin, Vladimir Aletov et al. · 0 citations
#machine learning Preprint Aug 2026

Sparse Competition during Training For the Emergence of Specialized Modules

This work introduces a method that maintains near-baseline accuracy, induces usage-based modularity by sparsely routing inputs to neuron groups, and encourages specialization of these modules, such that their activations are correlated with input classes.

Baptiste Rossigneux, Karim Haroun · 0 citations
#machine learning Preprint Aug 2026

A Human-in-the-Loop Autonomous Agent for Industry Time Series Forecasting

CastClaw is presented, a human-in-the-loop autonomous forecasting system built through forecasting-oriented harness engineering that connects data, specialized models, analytical tools, user input, and a versioned execution record in one runtime.

Xiaoyu Tao, Mingyue Cheng, Ze Guo et al. · 0 citations
#artificial intelligence Preprint Aug 2026

A Universal Context-Reuse Layer for Cross-Model KV Sharing

Results provide initial evidence that KV states can serve as transferable computational representations rather than strictly model-local caches, and motivate context mobility as a systems abstraction for reducing redundant prefill across heterogeneous LLM and multi-agent inference workflows.

Yi Li, Dongming Jiang, Yi Zhao et al. · 0 citations
#machine learning Preprint Aug 2026

Singular Curvature in ReLU Training:Differentiation and the Gradient-Flow Limit Need Not Commute

Gradient descent (GD) is explicit Euler for gradient flow, but a state-accurate continuous-time surrogate need not remain accurate after differentiation. At every fixed nonresonant step size, ordinary automatic differentiation exactly differentiates the executed hard-ReLU GD program. We prove that, over a fixed finite horizon, the GD states converge and these exact discrete derivatives approach an event-free regional propagator, whereas the derivative of the limiting flow also contains speed-normalized activation-event transfers. A prepoint Stieltjes representation separates the absolutely continuous regional Hessian from atomic interface curvature; one nonzero gradient jump produces an exactly rank-one endpoint discrepancy, and global convexity prevents complete multi-event cancellation whenever an event is strict. Nevertheless, a standard family of globally 1-strongly convex residual-ReLU squared-loss risks realizes arbitrarily large reciprocal sensitivity ratios on open initialization sets, with a uniform transversality margin. The same discrete-versus-flow decomposition extends to parameters and reverse-mode adjoints; resolved smoothing in the scalar or autonomous-normal regime and consistent event localization recover the flow sensitivity. The results concern deterministic full-batch, finite-horizon dynamics with a stable finite itinerary of separated same-direction transverse events; they are consistency theorems, not prevalence claims for large-scale training.

Xiao-Yang Li, Run-Ni Zhou · 0 citations
#machine learning Preprint Aug 2026

One Policy Is Enough: Single-Agent Reinforcement Learning Outperforms Tree Search for Chemistry Tool Learning

This model interleaves reasoning, tool calls, and returns in one left-to-right generation, trained by a supervised warm-up and then outcome-level reinforcement learning against a programmatic reward read directly off the gold call chain, which leaves no learned critic and no judge in the training loop.

Armin Dariani, Sifan Wu, Bang Liu et al. · 0 citations
#machine learning Preprint Aug 2026

Reproducible macroscopic dynamics in a closed-loop human-AI learning system

An externally anchored leading-order effective field linking empirical dynamics, an interpretable mechanism and neural computation is identified linking empirical dynamics, an interpretable mechanism and neural computation in closed-loop human-AI systems.

Min-Lin Wu, Xu Fang, Yi-Cheng Zhang et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Towards Stream Learning on Embedded Systems: Benchmarking the Memory Consumption of Stream Learning Methods

This work calls on the stream-learning community to make bounded resource usage a first-class design objective alongside drift adaptation, and proposes concrete steps toward this goal, including an API through which stream learners can explicitly expose and respect resource budgets.

Sebastian Buschjäger, N. Gunasekara, H. Gomes · 0 citations

From tech blogs

See all →
GPT-Lab Sep 3, 2026

Adaptive AI Agents in Construction Workflows

Adaptive AI agents can help make BIM data more machine-readable by navigating IFC models, interpreting inconsistent information, and mapping it to defined standards. In this blog, Alok Rawat shares findings from a real-world pilot in construction workflows. The post Adaptive AI Agents in Construction Workflows appeared first on GPT-Lab.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.