Accelerating Influence Function Estimation for Large Language Models: A Practical Design
StructInf, a structure-aware influence estimation framework that addresses the Fidelity Gap from coarse curvature approximations and the I/O bottleneck from materializing per-example gradients, is proposed, suggesting that practical IF for LoRA-tuned LLMs benefits from joint optimization of curvature modeling, memory m...