Skip to content
Preprint

Integrating Deep Learning and Contraction Theory for Robust Nonlinear State Estimation via Unsupervised Scientific Machine Learning

Jul 2026 · 0 citations · 36 references
Engineering Computer Science

TL;DR

A learning-based approach to determine both the observer's correction term and the contraction metric by incorporating the contraction requirements into the learning process and is extended to non-autonomous systems while keeping the correction term and contraction metric static to avoid generalization issues arising from time-dependent training.

Abstract

A common way to design observers is to add a correction term to a copy of the system; however, designing the correction term for nonlinear systems remains a significant long-standing challenge. Contraction theory offers a unified approach to designing this correction term by solving a matrix partial differential inequality (MPDI) and identifying a contraction metric. However, solving the MPDI for both the correction term and the contraction metric is highly challenging, both analytically and numerically. Therefore, the aim of this paper is to propose a learning-based approach to determine both the observer's correction term and the contraction metric by incorporating the contraction requirements into the learning process. The proposed approach relies on a scientific machine learning formulation that embeds the contraction conditions into the training loss function. The proposed approach is then extended to non-autonomous systems while keeping the correction term and contraction metric static to avoid generalization issues arising from time-dependent training. Computable bounds on the learning errors of the proposed observer are established as a function of the training residual and the sampling resolution. Furthermore, the robustness of the proposed observer to measurement noise and learning errors are established in an exponential input-to-state stability sense. Based on the robustness analysis, the present paper takes a further step by proposing a robust learning-based contraction nonlinear observer. The proposed observers are evaluated in numerical simulations for different contraction rates and measurement noise levels.

View source

Similar papers

Preprint Jul 2026

Learning Stable Controlled Dynamical Systems via Input-Contraction Neural Differential Models

This paper derives sufficient conditions for input-dependent contraction and formally establish an input-to-state contraction property under bounded external excitations, and develops a novel deep learning framework that seamlessly incorporates time-varying control inputs while ensuring incremental exponential convergence via input-dependent contraction regularization.

Syed Pouladi · 0 citations
Preprint Aug 2026

Kernel Methods for Learning Operators with Multiple Inputs and Outputs

This work introduces a general kernel-based encoder-decoder framework for operator learning that separates observation, representation, learning, and reconstruction, and develops this framework for multi-input, multi-output operator learning, where operators map between products of potentially distinct function spaces.

Adrien Weihs, Chunyang Liao, Jingmin Sun et al. · 0 citations
Preprint Jul 2026

Optimization under Persistent State-Dependent Bias: Gradient-based Method and Complexity Analysis

This paper studies the convergence of stochastic gradient descent when the implemented updates are subject to a persistent and state-dependent bias, in which the desired update is scaled by response functions component-wise, and proposes a gradient-based algorithm, termed Residual Learning.

Zhaoxian Wu, Quan Xiao, Tayfun Gokmen et al. · 0 citations
Preprint Aug 2026

Spectral Distillation: From Nonlinear Dynamics to Linear State-Space Models

This work first learns an implicit spectral predictor using Observation Spectral Filtering using Observation Spectral Filtering, a convex method that competes with the best linear observer for the system, and applies spectral-to-LDS distillation to convert this predictor into an explicit recurrent linear dynamical system.

Liane Galanti, Devan Shah, Shlomo Fortgang et al. · 0 citations
Preprint Jul 2026

A domain decomposition online-learning-enhanced nonlinear elimination preconditioner

Numerical experiments show that the proposed online-learning-enhanced nonlinear elimination preconditioner produces more reliable and coherent bad subsets, is robust with respect to both NE and learning parameters, and outperforms the baseline NE preconditioner in terms of the convergence.

Pai Zhang, Linyan Gu, Liulu Luo · 0 citations
Aug 2026

An iterative learning algorithm founded on the normalization principle and inverse triangular dynamic initial error compensation

To address the issues of low convergence accuracy and deteriorated output performance caused by initial state errors in linear time-invariant discrete-time systems, traditional iterative learning control methods typically treat initial errors as passively tolerated conditions. The lack of an active correction mechanism significantly limits the dynamic performance of the system. To overcome this limitation, this paper proposes a proportional-–integral-–derivative–type iterative learning control algorithm based on the normalization principle, incorporating a dynamic compensation term constructed via an inverse tangent function. First, by analyzing the impact mechanism of initial state errors on system output, a gradually decaying dynamic compensation term based on the arctangent function is designed under the normalization principle. This term is integrated into the control gain to enable active learning and smooth correction of initial errors. Second, the convergence condition of the proposed algorithm is derived, and the tuning guidelines for key parameters are provided. Theoretical analysis demonstrates that the system output error converges monotonically in the iteration domain. Finally, numerical simulations verify the effectiveness of the proposed algorithm. The results show that, under identical system conditions, the proposed method reduces the system output error by more than 80% compared to existing typical approaches, significantly improving both convergence speed and steady-state accuracy.

Baolin Dai, Yuhao Wang, Dubing Lv · 0 citations