Skip to content

Author

Prasanna Parthasarathi

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

DimPO: Dimensionality Reduction for Attention using Preference Optimization

The introduction of DimPO, which combines listwise preference optimization with a lightweight top-k cross-entropy term for head-fidelity, suggests that under dimensionality reduction, preserving the ordering and concentration of task-relevant attention can matter more than reproducing the full attention distribution.

Vojtěch Lanz, Yu-Fei Cui, Prasanna Parthasarathi · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.