What is 'Learning Rate'?

Approach: Define the step size taken during optimization.

A tuning parameter in an optimization algorithm that determines the step size at each iteration while moving toward a minimum of a loss function.

Follow-up: What are learning rate schedules?

Key concepts: step size, convergence, optimization.