On Minimax Optimality and Uniqueness of Fixed-Step First-Order Methods for Smooth Convex Optimization
This paper considers the design of optimal fixed-step first-order methods for high-dimensional minimization of $L$-smooth convex functions. For optimizing worst-case performance measured via suboptimality of the final function value (relative to the initial squared distance to a minimizer), we provide an algebraic proo...