What is gradient descent?
Gradient descent updates model parameters in the direction that reduces the loss function.
- Uses gradients of loss
- Step size is learning rate
- Variants include batch and mini-batch
What is gradient descent?
What is gradient descent?
Gradient descent updates model parameters in the direction that reduces the loss function.