Gradient Descent

Gradient Descent news and updates covering the optimisation method behind the training of neural networks and many other models. Readers can learn about learning rates and schedules, stochastic and mini-batch variants, momentum and adaptive optimisers such as Adam, convergence problems.