What is gradient boosting?

What is gradient boosting?

Approach: Describe iterative ensemble method.

Ensemble technique that builds models sequentially, each new model correcting errors of previous ones. Fits new model to negative gradient of loss function.

Follow-up: What is XGBoost?

Key concepts: boosting, gradient descent, weak learners.