Title:Optimal Convergence Rate for Mirror Descent Methods with Time-Varying Step Sizes Rules

Abstract:In this paper, the optimal convergence rate $O\left(N^{-1/2}\right)$ (where $N$ is the total number of iterations performed by the algorithm), without the presence of a logarithmic factor, is proved for mirror descent algorithms with time-varying step sizes, for solving both classical constrained non-smooth problems and problems with the composite model. The proven result is an improvement on the well-known rate $O\left(\log (N) N^{-1/2}\right)$ for the mirror descent algorithms with time-varying step sizes.