Randomized gradient-free methods in convex optimization

This review presents modern gradient-free methods to solve convex optimization problems. By gradient-free methods, we mean those that use only (noisy) realizations of the objective value. We are motivated by various applications where gradient information is prohibitively expensive or even unavailable. We mainly focus on three criteria: oracle complexity, iteration complexity, and the maximum permissible noise level.

Stochastic Gradient Optimization Techniques Sparse and Compressive Sensing Techniques Machine Learning and Algorithms

View graph Source

Paper

Similar papers

Gradient-Free Methods for Non-Smooth Convex Stochastic Optimization with Heavy-Tailed Noise on Convex CompactNikita Kornilov, Alexander Gasnikov, Pavel Dvurechensky et al.2023 · arXiv (Cornell University) In Library

Modern Theory of Gradient-Based OptimizationBin Shi2026 · arXiv (Cornell University) In Library

Decentralized Gradient-Free Methods for Stochastic Non-smooth Non-convex OptimizationZhenwei Lin, Jingfan Xia, Qi Deng et al.2024 · Proceedings of the AAAI Conference on Artificial Intelligence In Library

Gradient Based OptimizationSteven L. Brunton2026 · Optimization In Library

Decentralized Gradient-Free Methods for Stochastic Non-Smooth Non-Convex OptimizationZhenwei Lin, Jingfan Xia, Qi Deng et al.2023 · arXiv (Cornell University) · 12 citations In Library

Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex OptimizationTianyi Lin, Zeyu Zheng, Michael I. Jordan2022 · Neural Information Processing Systems · 89 citations In Library

Simple Stochastic Gradient Methods for Non-Smooth Non-Convex Regularized OptimizationMichael R. Metel, Akiko Takeda2019 · International Conference on Machine Learning · 23 citations In Library

A Survey of Optimization Methods in Machine Learning: From Gradient Descent to Convex OptimizationShizheng Song2026 · Applied and Computational Engineering In Library

An optimal gradient method for smooth (possibly strongly) convex minimizationAdrien Taylor, Yoel Drori2021 · HAL (Le Centre pour la Communication Scientifique Directe) In Library

Contemporary Stochastic Quasi-gradient AlgorithmsV. I. Norkin, Alexei A. Gaivoronski, P. S. Knopov et al.2025 In Library

Source of record

OpenAlex

44B

Welcome.

This panel sticks with you. Pick anything below and it opens right beside it, so you can dig through 60,000-plus records without ever losing your spot here.

Travel 44B

LibraryPapers, policy, standards, statute LabsEvery organization building AI ModelsIntelligence, price, and speed BenchmarksThe evaluation catalog IncidentsAI failures and harms SearchOne field across everything DashboardThe state of AI accountability in NY 44B RegistryThe Art. 44-B compliance portal