A pointwise deterministic bound is derived on the discrepancy between the kernel ridge regression estimator and the ground truth in the corresponding Hilbert space norm for a vector-valued operator under the framework of vector-valued kernel ridge regression.
Abstract
While kernel-based learning methods for scalar-valued functions have been extensively studied, comparatively little work considers nonlinear vector-valued operators. Such operators with vector-valued outputs, e.g., state vectors and trajectories, commonly arise in system identification problems. In this paper, we study the problem of learning a vector-valued operator under the framework of vector-valued kernel ridge regression. We assume that the outputs take values in an arbitrary Hilbert space and are corrupted by additive noise with bounded norm. Under the assumption that the unknown operator belongs to a vector-valued reproducing kernel Hilbert space, we derive a pointwise deterministic bound on the discrepancy between the kernel ridge regression estimator and the ground truth in the corresponding Hilbert space norm. Numerical simulations under two different scenarios are presented to validate the theoretical results.
Active subspaces identify low-dimensional linear structure in high-dimensional parameter-to-output maps by estimating the dominant eigenspace of a gradient covariance operator. In practice this covariance is replaced by a Monte Carlo estimator built from a limited number of gradient evaluations. Classical analyses base...
Fabio Nobile, Matteo Raviola, R. Tempone· 0 citations
Operator-theoretic generalization bounds for deep multi-output function classes are developed by representing network layers as Koopman composition operators on vector-valued reproducing kernel Hilbert spaces and derive Rademacher complexity bounds for invertible and width-expanding injective architectures.
Mahdi Mohammadigohari, Thomas Borsani, G. Di Fatta· 1 citation
We consider nonparametric regression with a Banach-space-valued predictor where the covariate takes values in a general separable Banach space. Our primary objective is to develop a unified framework for estimating the regression operator without relying on an inner-product structure, thereby extending classical and fu...
A Banach space-valued approximation framework based on symmetrized neural network (SNN) operators generated by a deformation-dependent sigmoidal activation function, yielding a positive, even, normalized, and localized density kernel satisfying the partition of unity.
G. Anastassiou, Seda Karateke, M. Zontul· Axioms· 0 citations
In this paper, we investigate the generalization performance of distributed gradient descent algorithms in a reproducing kernel Hilbert space under a robust loss function $l_{\sigma}$. By exploiting the spectral characterization of gradient descent together with the intrinsic properties of robust loss functions, we est...
This work introduces total sensitivity kernels (TSKs), a method based on families of weighted ANOVA kernels that learn and adapt to this multivariable structure, and establishes consistency of a finite-data formulation based on minimum-norm interpolation.
John E. Darges, Laura Weidensager· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
