What is the difference between Generative and Discriminative models?

What is the difference between Generative and Discriminative models?

Approach: Compare modeling the joint distribution vs the conditional distribution.

Discriminative models learn the boundary between classes by modeling P(y|x). Generative models learn the distribution of individual classes by modeling P(x,y) (or P(x|y)P(y)), allowing them to generate new data points.

Follow-up: Is Logistic Regression generative or discriminative?

Key concepts: joint probability, decision boundary.