Curvature-Aware Zeroth-Order Optimization for Memory-Efficient Test-Time Adaptation
An improved ZO method is proposed to substantially boost the performance of ZO optimization based TTA, which operates by freezing pretrained weights and optimizing minimal adapter parameters via forward-only passes based gradient estimation, which can substantially reduce the memory overhead compared to BP-based method...