Riccardo Miccini

Does per-frame early exit pay? A compute-matched study of dynamic depth for on-device speech enhancement

This paper supervise every intermediate depth of one causal model, then fine-tune its output heads to guarantee that deeper outputs are never worse than shallower ones, and can derive a family of static models that are more Pareto-efficient than their equivalently-sized counterparts trained from scratch on the same bud...