Skip to content

Author

Junhyuk Jo

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Ghosted Layers: Unconstrained Activation Alignment for Recovering Layer-Pruned LLMs

This paper derives a closed-form optimal linear operator from a small calibration set to reconstruct the activation discrepancy introduced by the pruned layers, and shows that this solution corresponds to the unconstrained optimum of the alignment objective, whereas LinearPatch is restricted to a fixed basis symmetric...

Vincent-Daniel Yun, Junhyuk Jo, Sai Praneeth Karimireddy et al. · 3 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.