Skip to content

Reciprocity Separates Gradient Flow from Rotation in Conservative Physical Learning

Aug 2026 · 1 citation · 23 references
Computer Science Physics

Abstract

Physical learning lets a trainable material or network use its own physical response to carry error signals, reducing the need for a separately programmed backward computation. We ask what determines whether such a system follows conventional gradient descent or evolves along a genuinely different learning trajectory. Our canonical model is a directed layered transport network in which every node redistributes a fixed amount of flow, so learning preserves positivity and total mass. In this model, conservation constrains only the allowable learning directions. Within the matched response class studied here, adjoint matching gives the physical output response a symmetric form. Non-negative mode-wise feedback then produces a reciprocal closed-loop response and a reweighted gradient flow. Adding an antisymmetric boundary component makes the closed-loop response rotational: the learning path can turn while the error driving that update still decreases at that moment. Turning is not automatically beneficial. Its finite-step effect is set by local curvature, and its accumulated effect also depends on step selection and on the new states visited along the path. Numerical consistency checks reproduce the exact response structure, predict the sign of the local effect across new network families, and show how trajectory drift can negate a local advantage. These results separate the roles of conservation, reciprocity, and nonreciprocity in physical learning.

View source

Similar papers

#machine learning Preprint Sep 2026

A pullback-corrected scalar auxiliary variable optimizer with momentum and adaptive mobility

A pullback-corrected scalar auxiliary variable (PB--SAV) method, one scalar tracks the shifted objective while the component gradients build a positive semidefinite curvature correction of rank at most the number of components, reducing to a dense system whose order is the number of components.

Jia-Hao Zhang, Shi-Heng Zhang, Guang Lin · 0 citations
Preprint Aug 2026

RODE: A Radial-Orthogonal Decoupled Engine for Optimization

This work introduces RODE, which gives the radial and directional components separate update rules and step sizes in the matrix Frobenius norm, and suggests that decoupling radial and directional dynamics offers a more effective and controllable approach to matrix optimization.

Guo-Xiang Xu, Bince Qu, Qi Sun et al. · 0 citations
Preprint Aug 2026

Accelerated Gradient Flow with Endogenous Gradient-Memory Anchor: Selection and Restoring Damping

We introduce an accelerated gradient flow with an endogenous gradient-memory anchor and a nonlinear restoring--damping feedback. The anchor evolves from a weighted history of the gradients, while the nonlinear feedback is modulated by the squared coordinatewise displacement from the anchor. The resulting dynamics uses...

C. Izuchukwu, Ernest Obini, Jen-Chih Yao et al. · 0 citations
Preprint Sep 2026

In situ local learning of dynamic network materials

Functional materials realize functionalities through pre-designed structures, whereas physical neural networks are trained by prescribing input-output behavior. Unifying these views would allow materials to acquire functions directly from dynamical tasks. Here we introduce an in situ local learning framework for dynami...

Shuai-Feng Li, Xiao-Ming Mao · 1 citation
#machine learning Preprint Sep 2026

Same Loss, Different Gradients

Differentiable learning typically assumes that the scalar objective evaluated in the forward pass and the gradient supplied to the optimizer in the backward pass describe the same mathematical object. We show that this correspondence can fail when probabilistic objectives rely on finite special-function recurrences, cu...

Ning-Kang Peng, Xiao-Qian Peng, Yi-Fan He et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.