This work introduces a nonlinear Hager-Zhang conjugate gradient method for solving set optimization problems. The objective function under consideration is defined by a finite collection of continuously differentiable functions. Notably, the proposed approach imposes restrictions neither on the existence of a finite generator of the ordering cone nor on any regularity condition at the optimal solution. As a result, the proposed method holds considerable significance for both set optimization and vector optimization problems, with the latter serving as a special case of the former. The study begins by discussing Wolfe line search conditions using Drummond-Svaiter scalarization function. Thereafter, we establish the existence of a step length satisfying the Wolfe line search conditions along a descent direction. The Hager-Zhang scalar conjugate parameter is introduced to derive the search direction for the proposed method. It is established that the direction generated by the proposed method is a descent direction. The well-definedness of the proposed method is given. Furthermore, we discuss some important results and a Zoutendijk-like condition to ensure global convergence. Subsequently, the global convergence of the proposed method is established in an asymptotic manner. Finally, numerical experiments on various test problems validate the practical performance and effectiveness of the proposed technique.
This study develops a projection-based descent method for minimizing weakly semismooth functions over polyhedral sets, taking an initial step toward extending projection-based descent algorithms to nonsmooth, nonconvex optimization problems. At each iteration, the method considers an inner approximation of the Clarke $...
Four groups of subspace methods for nonlinear monotone equations, with applications to large-scale machine learning problems, using Jacobian-free subspace directions of conjugate-gradient type combined with either fixed step sizes or variable step sizes generated by the projected method of Solodov and Svaiter are intro...
M. Kimiaei, Shima Shabani, Michael Breuß· 0 citations
The quadratic optimization-free (QO-free) method is a class of powerful and effective algorithms for solving nonlinearly constrained optimization problems in Euclidean spaces. The aim of the present work is to extend this method to solve optimization problems on manifolds with additional equality and inequality constra...
Chun-Ming Tang, Hao He, Wen Huang et al.· 0 citations
A minimal-gradient subspace method for unconstrained optimization of SPD quadratics, which attains the highest success count, whereas L-BFGS requires fewer median gradient evaluations and less CPU time.
Oscar Dalmau, H. D. de la, Cruz Cansino· 0 citations
It is shown that Fr\'echet or proximal stationarity can be characterized through asymptotic vanishing of the proposed measure along some convergent sequence and analogous asymptotic results for a smoothing-based variant of the measure are established.
Keita Kume, Isao Yamada· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.