Stochastic Gradient Descent and Its Variants in Machine Learning
Journal of the Indian Institute of Science, pp. 201-213, 2019.
Stochastic optimization Gradient descent Large scale optimization
Stochastic gradient descent (SGD) is a fundamental algorithm which has had a profound impact on machine learning. This article surveys some important results on SGD and its variants that arose in machine learning.
Full Text (Upload PDF)
PPT (Upload PPT)