New insights in smoothness and strong convexity with improved convergence of gradient descent
The starting assumptions to study the convergence and complexity of gradient-type methods may be the smoothness (also called Lipschitz continuity of gradient) and the strong convexity. In this note, we revisit these two basic properties from a new perspective that motivates their definitions and equivalent characterizations, along with an improved linear convergence of the gradient descent method.
Paper
References (11)
10Convex Analysis2015 · Princeton University Press
11and M2016 · Schmidt, Linear convergence of proximal-gradient methods under the Polyak- Lojasiewicz condition., arXiv:1608.04636v1 [cs.LG] 16 Aug 2016.,