Mohamed Amine Kina

On the Failure of Boundary-Seeking Distillation in Bottlenecked Generative Architectures

This work reformulates continuous reconstruction as a dense, per-feature classification task, allowing the decoder to output categorical logits and shows that boundary-seeking objectives are fundamentally ill-posed in bottlenecked generative architectures.