Explain the concept of Data Partitioning.

Explain the concept of Data Partitioning.

Approach: Describe logical division of large datasets.

The technique of dividing a large dataset into smaller, manageable parts based on a specific column (e.g., date). It allows the execution engine to skip irrelevant data during queries (partition pruning).

Follow-up: What happens if you over-partition data?

Key concepts: pruning, file organization.