Data Attribution via Sketched Metadifferentiation
Two algorithms, MAGE and SPELL, suited for reconstruction and attribution respectively, are presented, that run on existing metagradient machinery at no extra cost and demonstrate strong performance over existing baselines across training scales and measurement budgets.
Yu-Xi Chen, Hamza Golubovic, Han Tong et al.
· 0 citations