This work proposes a multiscale primal-dual interior-point relaxation method (IPRM), which can handle instances whose full formulations contain trillions of transport variables and develops an effective support-identification strategy based on the approximate solutions obtained by IPRM.
Abstract
Large-scale optimal transport (OT) problems involve a vast number of transport variables, leading to prohibitive memory and computational costs. To address these challenges, we propose a multiscale primal-dual interior-point relaxation method (MSIPRM). The multiscale outer framework constructs a hierarchy of standard OT problems at progressively finer levels. At each level, the OT problem is solved over a sequence of adaptively refined active sets initialized based on the solution support at the previous level. This yields a sequence of closely related sparse subproblems, thereby substantially reducing memory requirements. The primal-dual interior-point relaxation method (IPRM) serves as the inner solver for each sparse subproblem. Since IPRM does not require strictly interior iterates, it can readily use the solution of the previous subproblem as a warm start. To efficiently obtain the Newton direction, we solve a reduced Schur complement system derived from the normal equations. Furthermore, we develop an effective support-identification strategy based on the approximate solutions obtained by IPRM. We establish condition number estimates for the Schur complement matrices and analyze the global and local convergence properties of the algorithm. Numerical experiments on large-scale test problems demonstrate the computational efficiency and scalability of MSIPRM and show that it compares favorably with existing solvers. In particular, MSIPRM can handle instances whose full formulations contain trillions of transport variables.
This paper proposes an inexact interior-point relaxation method (iIPRM) for LO problems that does not require its iterates to remain strictly positive and employs a sparse preconditioner tailored to the structure of the normal matrix.
Rui-Jin Zhang, Yu-Hong Dai, Xin-Wei Liu et al.· Journal of Optimization Theo...· 0 citations
Interior-point methods (IPMs) are among the most widely used algorithms for constrained optimization, yet their Newton-based search directions require costly second-order information and large linear-system solves. Learning to optimize offers cheaper updates learned from data, but the singular behavior of logarithmic b...
A. Madabhushi, Jia-Lin Liu, Min-Xin Zhang· 0 citations
An efficient tree-based implementation is developed, which accelerates POA's core subroutines while storing the outer-approximation compactly and introduces polyblocks, an open-source Python package implementing the proposed algorithms alongside a framework for developing new POA variants.
This work proposes an inexact primal-dual Newton method with an inner solver based on the conjugate residual (CR) method, which handles indefiniteness in the subproblem directly as it arises and establishes worst-case global convergence guarantees and strong empirical performance on large-scale, nonconvex problems.
Saddle-point problems play an important role in modern machine learning, including robust optimization and algorithmic fairness. We investigate structured convex--concave minimax problems where the primal variable lies in a high-dimensional, unconstrained space $\mathbb{R}^d$, while the dual variable is confined to a c...
Clément Lezane, Sophie Langer, Wouter M. Koolen· 0 citations
A novel strategy based on two convex combinations is developed, integrated into a primal-dual framework, and a new primal-dual algorithm with linesearch is proposed, termed NPDAL-n, for general convex-concave saddle-point problems.
Zexian Liu, Shuning Liu, Jia-Long Li· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.