Adaptively Incorporating Directional Hints into Zeroth-Order Optimization
Control-Variate Zeroth-Order Descent (CV-ZOD) is introduced, a new framework that refines the classical zeroth-order gradient estimator with a control variate that can be set based on the directional hints to leverage these hints adaptively while maintaining robustness to their quality.