Library

The convergence of the Stochastic Gradient Descent (SGD) : a self-contained proof

We give here a proof of the convergence of the Stochastic Gradient Descent (SGD) in a self-contained manner.

stat.MLcs.LGmath.PRMathematicsComputer Science
View graphSource

Paper

Similar papers

Stochastic Gradient Descent RevisitedAzar Louzi2024 · 1 citation In Library
On the Convergence of mSGD and AdaGrad for Stochastic OptimizationRuinan Jin, Yu Xing, Xingkang He2022 · arXiv (Cornell University) · 12 citations In Library
On the Almost Sure Convergence of Stochastic Gradient Descent in Non-Convex ProblemsPanayotis Mertikopoulos, Nadav Hallak, Ali Kavis et al.2020 · HAL (Le Centre pour la Communication Scientifique Directe) In Library
Convergence rates and approximation results for SGD and its continuous-time counterpartXavier Fontaine, Valentin De Bortoli, Alain Durmus2020 · arXiv (Cornell University) In Library
Handbook of Convergence Theorems for (Stochastic) Gradient MethodsGuillaume Garrigos, Robert M. Gower2023 · arXiv (Cornell University) In Library
Global Convergence and Stability of Stochastic Gradient DescentVivak Patel, Shushu Zhang, Bowen Tian2021 · arXiv (Cornell University) · 36 citations In Library
Retracted: Efficient Convergence Analysis of Stochastic Gradient Descent for Large-Scale OptimizationAnanya Saha, Rakesh Kumar Yadav, Rakesh Dwivedi2024 In Library
On the Almost Sure Convergence of Stochastic Gradient Descent in Non-Convex ProblemsPanayotis Mertikopoulos, Nadav Hallak, Ali Kavis et al.2020 · arXiv (Cornell University) · 120 citations In Library
Stochastic Gradient Descent for Nonconvex Learning without Bounded Gradient AssumptionsYunwen Lei, Ting Hu, Guiying Li et al.2019 · IEEE Transactions on Neural Networks and Learning Systems · 144 citations In Library
A Stochastic Gradient Descent Theorem and the Back-Propagation AlgorithmHao Wu2021 · arXiv (Cornell University) · 2 citations In Library
© 2026 NYSGPT2525 LLC