We study deterministic and stochastic optimization over the Stiefel manifold, explicitly allowing iterates to deviate from the manifold rather than enforcing feasibility via retraction at each step. We introduce Landom, a Landing-type method that constructs momentum in the relative-gradient direction, maps this update...
Yuxuan Zeng, Qin-Wen Deng, D. Ge et al.· 0 citations
This work proposes Hybrid Momentum (HyM), which combines a linearly weighted average of past gradients with a geometrically discounted fast momentum, and proposes HyMUON, which applies Newton--Schulz orthogonalization to the hybrid direction.
Hai-Feng Xu, Yi-Jin Ren, Chenyu Zhou et al.· 0 citations
By leveraging the hidden low-rank structure of large SDPs with sparse problem data, it is demonstrated that the parallel processing power of modern graphics processing units can substantially accelerate the solution process and enable much larger problems to be solved.
Qiu-Shi Han, Zhen-Wei Lin, Han-Wen Liu et al.· Proceedings of the National...· 1 citation
Let $\Delta_u(d,n)$ be the maximum graph diameter of a pointed $d$-dimensional polyhedron with $n$ facets. Using a curved-path encoding of the iterated Kalai--Kleitman recurrence, we prove, uniformly over $n\geq d\geq 4$, \[ \Delta_u(d,n) \leq (n-d)^{\log_2 G_d},\qquad G_d = (4\ln 2+o(1))\frac{d}{(\ln d)^2}, \] where t...
This work shows empirically that solver-integrated reasoning, exact combinatorial algorithm, and heuristic search exhibit complementary strengths across different problem structures and scales, and introduces Strategy-Diverse Reinforcement Learning (SDRL), which trains LLMs as adaptive optimization meta-solvers.
Shi-Hao Zhang, Wei-Ting Liu, Si-Yu Shao et al.· 0 citations
PDHCG-CQP achieves state-of-the-art robustness among first-order solvers while scaling efficiently to 8 GPUs and instances with up to $4.4\times10^8$ stored primal coordinates.
Hongpei Li, Yicheng Huang, Hui-Kang Liu et al.· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.