What is 'Gradient Explosion'?

What is 'Gradient Explosion'?

Approach: Describe gradients becoming excessively large during backpropagation.

An error in neural network training where large error gradients accumulate and result in very large updates to neural network weights during training. This makes the model unstable.

Follow-up: How does gradient clipping solve this?

Key concepts: clipping, stability, weights.