Laurits Fredsgaard

Semi-Supervised Learning for Molecular Graphs via Ensemble Consensus

This work finds that training with an ensemble consensus objective increases robustness in models and exhibits an effect similar to knowledge distillation; an individual member of an ensemble trained this way outperforms a full ensemble trained in a traditional supervised fashion in almost all cases.