What is the difference between Batch and Online Learning?

What is the difference between Batch and Online Learning?

Approach: Compare learning from the whole dataset vs learning from incoming data points.

Batch learning (offline) trains the model on the entire dataset at once. Online learning (incremental) updates the model continuously as new data arrives, which is useful for systems where data changes rapidly or is too large to fit in memory.

Follow-up: What is 'catastrophic forgetting'?

Key concepts: incremental learning, retraining, streaming.