Skip to content
Preprint

A note on the complexity of random subspace model-based methods for derivative-free optimization

Aug 2026 · 2 citations · 9 references
Mathematics

Abstract

We demonstrate that, with a suitable rescaling, using Johnson-Lindenstrauss transforms (JLTs) in the random subspace model-based derivative-free optimization (DFO) algorithm from [Cartis&Roberts, Math. Prog. 199 (2023)] achieves an improved worst-case evaluation complexity bound compared to'unscaled'JLTs. This improved bound does not require any modification to the original algorithm or complexity analysis, and matches the best-known bound in terms of dimension dependence for model-based DFO (e.g. achieved by [Scheinberg&Chaudhry, ICM 2026] using Haar matrices in a similar framework).

View source

Similar papers

Preprint Aug 2026

On the Complexity of BFGS Method for Smooth Convex Optimization

A global iteration complexity bound is established for the smallest gradient norm among the first $k$ iterates for the smallest gradient norm among the first $k$ iterates when the initial sublevel set is bounded.

Lijun Ding, Jin-Wen Yang, Baoyu Zhou · 0 citations
Preprint Sep 2026

Powell-Style Model-Based Derivative-Free Optimization with Complexity Guarantees

We propose variants of model-based trust region derivative-free algorithms that are closest to methods initially proposed and implemented by Powell. These methods rely on low degree polynomial interpolation and carefully maintain geometry of the interpolation sets. We are able to derive complexity bounds for these meth...

A. Chaudhry, K. Scheinberg, Scholar Sun · 0 citations
Preprint Sep 2026

Subspace methods for min-max problems

Four groups of subspace methods for nonlinear monotone equations, with applications to large-scale machine learning problems, using Jacobian-free subspace directions of conjugate-gradient type combined with either fixed step sizes or variable step sizes generated by the projected method of Solodov and Svaiter are intro...

M. Kimiaei, Shima Shabani, Michael Breuß · 0 citations
Preprint Aug 2026

Discrete eigenvalue optimization from entropic smoothing and first-order methods

We study the maximization of the minimum eigenvalue under combinatorial and integrality constraints. We propose a new approach based on branch-and-bound combines entropic smoothing of the minimum eigenvalue function and Frank-Wolfe methods over concave relaxations of the constraints, thereby exploiting combinatorial st...

Deborah Hendrych, Mathieu Besançon, Sebastian Pokutta · 0 citations
Preprint Sep 2026

A dimension-free bound for isoperimetry of unconditional log-concave measures

We prove a dimension-free Poincar\'e inequality for isotropic unconditional log-concave probability measures, establishing the Kannan-Lov\'asz-Simonovits (KLS) conjecture in the unconditional setting. The proof combines a new application of Dunkl operator theory combined with an appropriate transformation of the log-co...

Dan Mikulincer, Ilias Zadik · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.