What is random forest?

What is random forest?

Approach: Describe ensemble of decision trees.

Ensemble method that constructs many decision trees during training and outputs mode (classification) or mean prediction (regression). Uses bagging and random feature selection.

Follow-up: How to avoid overfitting?

Key concepts: ensemble learning, bagging, decision trees.