What is overfitting?

What is overfitting?

Approach: Explain when model fits noise rather than signal.

When model fits training data too closely, capturing noise as if it were signal, leading to poor performance on new data. Usually occurs with overly complex models relative to data.

Follow-up: How to prevent it?

Key concepts: bias-variance tradeoff, generalization, regularization.