Skip to content

Author

Lucius Bushnaq

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Oct 2026

Interpreting Language Model Parameters

The method, adVersarial Parameter Decomposition (VPD), optimizes for decompositions of neural network parameters into simple subcomponents that preserve the network's input-output behavior even when many subcomponents are ablated, including under ablations that are adversarially selected to destroy behavior.

Lucius Bushnaq, Dan Braun, Oliver Clive-Griffin et al. · 4 citations · ⚡1
#machine learning Preprint Aug 2026

Functional Degeneracy in Neural Networks: Measurement and Pruning

This work quantifies functional degeneracy through the behavioral recovery rank, defined as the number of leading behavioral-Hessian eigendirections required to recover a trained model's performance, and finds that structural and magnitude pruning retain more degrees of freedom, even after the task is saturated.

M. Matveev, P. Esser, Ayush Bharadwaj et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.