What is 'Data Skew'?

What is 'Data Skew'?

Approach: Explain uneven data distribution across nodes.

A condition in a distributed system where data is not distributed evenly across partitions, causing some nodes to do significantly more work than others, leading to 'straggler' tasks.

Follow-up: How can you fix skew in a join operation?

Key concepts: bottleneck, straggler tasks.