We have 3 of 21 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
GoldiMask is introduced, which selects tokens to reveal as context by approximately maximizing a submodular objective and weights the remaining targets according to how they benefit from the selected context and their remaining learning potential.
Block normalization generally improves Adam and closes part of its gap to Muon across molecular force prediction on the rMD17 and MD22 datasets, QM9 molecular property prediction, and charged particle dynamics.
This work proposes Teacher Rollout Extension (TREX), a knowledge distillation framework that transfers the predictive capability of a pretrained foundation model into a compact and efficient student that can match or surpass the teacher's accuracy while reducing the number of parameters by several orders of magnitude a...
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
