NGN: Learning Neural Network Size as a Differentiable Count
The Neurogenesis Network (NGN), a differentiable parameterization for learning how many ordered structural components a model should use, is introduced and results show that structural capacity can be optimized directly as a count.
Li-Xing Li
· 0 citations