What is a learning rate?
The learning rate controls how large each parameter update step is during training.
- Too high can overshoot
- Too low learns slowly
- Often tuned experimentally
What is a learning rate?
What is a learning rate?
The learning rate controls how large each parameter update step is during training.