Explain 'Information Gain'.

Explain 'Information Gain'.

Approach: Describe the reduction in entropy after splitting a dataset.

A metric used to decide which feature to split on at each step in building a decision tree. It is the decrease in entropy after a dataset is split on an attribute.

Follow-up: What is the formula for entropy?

Key concepts: entropy, decision trees, split.