Brownian Heads for Deep ReLU Representations: Activation Mass and the Cost of Same-Sample Selection
This work studies the conditional empirical Rademacher complexity of deep ReLU representations followed by bounded-norm predictors in additive or L\'evy-Brownian RKHSs, termed Brownian heads, and derives an exact dual identity and sharp bounds in terms of activation mass, the average norm of the observed hidden vectors...