Lost in the bf16 Cast: Exporting Ternary Language Models Can Revert Most Low-Learning-Rate Code Changes
In two model families, randomized interventions on the initial distance from the threshold support distance-dependent selection of the codes that fine-tuning changes, and in two model families, randomized interventions on the initial distance from the threshold support distance-dependent selection of the codes that fin...
Avichal Sahai, Nishant Raj, Animesh Srivastava
· 0 citations