B. Gelder

APQF: Agentic Profiling-Guided Structured Pruning and Mixed-Precision Quantization with Adaptive Fine-Tuning

This work introduces APQF, an agentic profiling-guided framework that combines structured pruning, mixed-precision quantization-aware training, and accuracy recovery in one automated pipeline, and is the first framework to combine LLM-guided, profiling-grounded decisions with a fully training-aware pruning and quantiza...