Back to search

What is regularization?

Regularization discourages overly complex models so they generalize better.

Machine Learning Medium Theory

What is regularization?

Regularization discourages overly complex models so they generalize better.

  • L1 can drive weights to zero
  • L2 shrinks weights smoothly
  • Early stopping is also a regularization idea

What is regularization?