Title:Power Proximal Point and Augmented Lagrangian Method

Abstract:In this paper we study an unconventional inexact Augmented Lagrangian Method (ALM) for convex optimization problems, wherein the penalty term is a potentially non-Euclidean norm raised to a power between one and two. We analyse the algorithm through the lens of a nonlinear Proximal Point Method (PPM) applied to the dual problem. While the scheme is well-understood for Euclidean norms our focus in on the non-Euclidean case which prevents us from using standard tools such as the nonexpansiveness of the proximal mapping. To allow for errors in the primal update, we derive two implementable stopping criteria under which we analyze both the global and the local convergence rates of the algorithm. More specifically, we show that the method enjoys a fast sublinear global rate in general and a local superlinear rate under suitable growth assumptions. We experimentally illustrate the merits of our approach on the task of quadratic programming with equality constraints and linear programming with inequality constraints using an off-the-shelf L-BFGS-B oracle for the subproblems.