SARATHI: Decoupled Data-Free Probing and Adaptive Reconstruction for Structured LLM Pruning
Structured pruning reduces the inference cost of large language models (LLMs) by permanently removing neurons and weight rows, yielding dense, hardware-agnostic speedup. Existing post-training methods couple neuron selection and weight reconstruction through a shared calibration dataset, introducing domain bias and out...