What is a 'Wide Transformation' in Spark?
What is a 'Wide Transformation' in Spark?
Approach: Describe transformations that require a shuffle.
A transformation where data from multiple partitions is required to compute the result, necessitating a data shuffle across the network.
Follow-up: What is a 'Narrow Transformation'?
Key concepts: groupby, join, shuffle.