An efficient proximal point algorithm (PPA) is developed to solve the stationary dual problem and the SNA subroutine is incorporated into the inexact PPA to solve jump-sparse signal recovery and computed tomography (CT) image restoration.
Abstract
Many image-processing problems can be formulated as composite cardinality optimization (CCOP), whose objective is the sum of two convex terms and a cardinality function composed with a linear operator. The composite cardinality term creates major algorithmic challenges: the separability of the cardinality function is lost and convergence analysis often requires surjectivity-type assumptions on the linear operators. To overcome these challenges, we consider the stationary dual formulation of CCOP, which has more favorable structure consisting of two convex terms and a separable cardinality function. In this paper, we develop an efficient proximal point algorithm (PPA) to solve the stationary dual problem. The efficiency of our PPA stems from two aspects. Firstly, the key step of its subproblem solver minimizes a smooth convex function over a low-dimensional subspace by the classic semismooth Newton algorithm (SNA), which has global convergence and local superlinear rate under suitable conditions. Secondly, implementable inexact criteria are proposed for early termination of the SNA subroutine. These components form the basic framework of our inexact PPA. Under suitable conditions, it enjoys global convergence and local linear convergence rate. In particular, we provide examples in which the convergence assumptions are automatically satisfied. Finally, the SNA subroutine is incorporated into our inexact PPA to solve jump-sparse signal recovery and computed tomography (CT) image restoration. Numerical results demonstrate the time efficiency and solution accuracy of our proposed method.
This work proposes a time-smoothed proximal linear algorithm and a local-regret measure based on a proximal residual mapping that is a proper stationarity measure for the original problem: its fixed-point condition implies first-order stationarity.
Jingwei Ji, Jong-Shi Pang, Renyuan Xu· arXiv.org· 0 citations
An efficient tree-based implementation is developed, which accelerates POA's core subroutines while storing the outer-approximation compactly and introduces polyblocks, an open-source Python package implementing the proposed algorithms alongside a framework for developing new POA variants.
The convergence analysis of the proximal gradient method with line search provides a theoretical advancement over the convergence results previously established for the steepest descent method in set-valued optimization problems.
Ravi Raushan, Debdas Ghosh, Anshika et al.· 0 citations
In this paper, we propose a balanced augmented Lagrangian method based on accelerated stochastic ADMM (b-ASADMM) to efficiently solve structured separable nonconvex optimization problems subject to linear constraints. The objective function in this problem comprises potentially nonsmooth and smooth functions, where the...
A novel strategy based on two convex combinations is developed, integrated into a primal-dual framework, and a new primal-dual algorithm with linesearch is proposed, termed NPDAL-n, for general convex-concave saddle-point problems.
This paper proposes a general line-search Newton framework for unconstrained optimization that avoids repeated Hessian regularization by exploiting the Newton direction only when it is well-defined and suitable and provides the first Newton-type algorithm together with a comprehensive convergence analysis for this impo...
Phat Thanh Vo, Tuyen Tran· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.