What is 'Backpropagation Through Time' (BPTT)?

What is 'Backpropagation Through Time' (BPTT)?

Approach: Describe backpropagation applied to recurrent neural networks.

An extension of backpropagation used for Recurrent Neural Networks (RNNs). The network is 'unrolled' through time steps, and the gradient of the loss is calculated for each time step before updating weights.

Follow-up: What is the main problem with long sequences in BPTT?

Key concepts: unrolling, gradients, sequential data.