2026· IEEE Signal Processing Letters· Vol 33, pp. 3691-3695· 0 citations· 34 references
Abstract
Conventional adaptive filter (AF) algorithms based on the stochastic gradient descent (SGD) criterion suffer severe performance degradation in the presence of impulsive noise. To tackle this issue, this letter first proposes a robust arctangent exponential (RATE) loss function to improve robustness against impulsive noise. However, AF algorithms using the RATE loss function fail to maintain stable convergence and may even diverge when the input signals are also corrupted by impulsive noise. Recently, the fractional-order SGD (FoSGD) criterion has proven effective in guaranteeing stable convergence of AF algorithms for impulsive inputs. Nevertheless, FoSGD-based AFs formulated within the Euclidean space suffer from degraded convergence rate and steady-state accuracy when processing non-Euclidean data. To overcome the above issues and speed up convergence for correlated input signals, we extend the FoSGD criterion to the Riemannian manifold optimization framework and develop the subband RATE fractional-order Riemannian SGD (SRATE-Fo-RSGD) algorithm. This algorithm degenerates into SRATE-RSGD when the fractional-order $\zeta$=1. Numerical results show that the proposed algorithms within the Fo-RSGD framework outperform conventional RSGD-based counterparts in terms of convergence and steady-state performance. To alleviate the limitation of fixed learning rate, we further propose its variable learning rate (VLR) variant, SRATE-Fo-RSGD-VLR. Finally, simulation results verify that the proposed algorithms outperform existing benchmark algorithms.
This study aims to develop a stochastic optimization algorithm that accelerates and stabilizes convergence in large-scale nonconvex machine learning problems. Motivated by the limitations of stochastic gradient descent and existing stochastic conjugate gradient methods, we propose an inertial-accelerated framework...
Meng-Qi Pan, Yi-Jia Wang, Shao-Liang Shi et al.· Engineering computations· 0 citations
It is proved that SGD with clipping and additive Gaussian noise (SGD-CN) converges almost surely (a.s.) under smoothness and uniformly bounded stochastic-gradient noise assumptions, provided the step sizes satisfy some standard decaying conditions.
Stochastic gradient descent (SGD) and randomized block coordinate descent (RBCD) belong to two fundamentally different classes of stochastic iterative regularization methods, and are promising and popular for solving large-scale inverse problems, due to their excellent scalability with respect to data size and signal s...
In this article, a robust model-free adaptive control (MFAC) algorithm is proposed based on the maximum correntropy Kalman filter (MCKF) for a class of multiple-input-multiple-output discrete-time nonlinear systems subject to non-Gaussian noise. The proposed algorithm relies solely on input-output data without requirin...
Guo-Jie Li, Ping Zhou, Tao Yang et al.· IEEE Transactions on Cyberne...· 0 citations
Distributed multichannel active noise control (ANC) is scalable, but filtered-x least-mean-square updates are highly sensitive to impulsive disturbances. This paper proposes a robust augmented-diffusion filtered-x maximum correntropy criterion algorithm (R-ADFxMCC). It keeps the fixed admissible combination of augmente...
While multikernel correntropy, as a powerful local similarity measure, has demonstrated superior robustness against non-Gaussian noise and outliers, existing approaches are limited by their reliance on homogeneous kernels and suboptimal treatment of free coefficients. To address this gap, this article introduces the co...
D. Nguyen, Hai-Quan Zhao, Jin-Hui Hu· IEEE Transactions on Reliabi...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.