This work considers solving an optimization instance in which the objective is quadratic and where the decision variable is a probability measure, and proposes a hierarchy of convex relaxations based on searching over probability measures over products of the base space that converges to the globally optimal solution.
Abstract
We consider solving an optimization instance in which the objective is quadratic and where the decision variable is a probability measure. Our class of problems are motivated by applications arising from optimal transport (with the Gromov-Wasserstein problem being a prominent example) as well as energy landscape minimization. Because the objective depends quadratically on the decision variable, our class of problems fall outside the standard modeling framework of the Generalized Moment Problems (which requires the objective to be linear). To this end, we propose a hierarchy of convex relaxations based on searching over probability measures over products of the base space. These have a natural interpretation with the moment Sum-of-squares hierarchy-a prominent framework for solving polynomial optimization instances, which we adapt to accommodate probability measures. A key conceptual contribution is to introduce a notion of positive-semidefiniteness that extends the usual notion over matrices. Under the assumption that the decision variables satisfy certain marginal constraints (as in the Kantorovich formulation of the optimal transport problem), we establish convergence of our hierarchy towards the globally optimal solution. Under the additional assumption that the objective is a polynomial, we propose a moment-SOS type hierarchy of finite dimensional semidefinite programs whose optimal solution converges to that of the original quadratic optimization over measures. We demonstrate our framework with numerical experiments. More generally, optimization over measures where the objective and/or constraint depends on the decision in a polynomial way is a fundamental problem. It is hoped that our work provides a road-map as to how the ideas of the SOS-ordinarily developed for polynomial optimization-may be applied to a broader class of non-linear problems involving measures.
It is shown that a class of binary optimization problems with complex non-quadratic objectives or constraints can be reformulated as multi-objective quadratic unconstrained binary optimization problems and evaluated classically on Pareto-optimal candidates rather than encoded as penalties.
Andres D. Ruiz, Soumyadip Ghosh, S. Woerner· 1 citation
A unified framework, based on decision diagrams, is proposed that serves both to solve the associated optimization problems and to construct ideal conic quadratic extended formulations of the closure of the convex hull of the underlying mixed-integer set.
Soobin Choi, S. Fattahi, Andrés Gómez et al.· 1 citation
It is demonstrated through a numerical study on a distributionally robust mean-risk portfolio optimization problem using simulated data that the worst-case distributions can be computed efficiently and utilized to obtain probabilistic interpretation of worst-case solutions.
N. Dizon, V. Jeyakumar· Optimization Letters· 0 citations
The algorithm is parameterized so as to address various stochastic formulations spanning from Expectation-focused to Value-at-Risk (VaR) as well as Conditional-Value-at-Risk (CVaR) as well as Conditional-Value-at-Risk (CVaR)-focused formulations.
This work derives the generalized score matching objective on a convex subset of $\mathbb{R}^{d}$ constructively starting from Minimum Probability Flow (MPF) learning, and shows how classical score matching as well as domain-adapted variants for non-negative data arise naturally within the proposed framework.
Nishanth Shetty, Saisuchith Mahajan, C. Seelamantula· 0 citations
A shrinkage path heuristic is proposed that reduces the solution of a DRO problem to a one-dimensional search over the line segment connecting the sample average approximation (SAA) and the (more demanding but practically solvable) classical robust optimization solution.
Ling-Jun Meng, Ryan Cory-Wright, W. Wiesemann· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.