Gradient Descent Finds the Cubic-Regularized Nonconvex Newton Step

We consider the minimization of a nonconvex quadratic form regularized by a cubic term, which may exhibit saddle points and a suboptimal local minimum. Nonetheless, we prove that, under mild assump...