Lecture 8: Gradient Descent (and Beyond)

Numerical Methods Lec24 Ch08-2 Gradient-Based Optimization2 - Gradient Descent Algorithm And Example

Gradient descent (article)

Variations of Gradient Descent I. Stochastic Gradient Descent…, by Yiyan Ge

Gradient descent with linear regression from scratch in Python - Dmitrijs Kass' blog

Gradient Descent and Back-tracking Line Search, by Andreas Maier, CodeX

Deep Learning Book: Chapter 8— Optimization For Training Deep Models Part I, by Aman Dalmia, Inveterate Learner

4. Beyond Gradient Descent - Fundamentals of Deep Learning [Book]

Applied Sciences, Free Full-Text

An overview of gradient descent optimization algorithms

Lecture 7: Gradient Descent (and Beyond)

Gradient Descent, Normal Equation, and the Math Story., by Evangelos Patsourakos, The Startup

Effortless optimization through gradient flows – Machine Learning Research Blog

Applied Sciences, Free Full-Text