Full-Covariance Smoothing of Bayesian Neural Networks for Online Adaptation
A one-step-per-layer smoother that approximates as Gaussian only each layer's affine output is derived that applies both to deterministic systems with noisy observations and to stochastic systems described by output statistics.