What is the difference between a Hyperparameter and a Parameter?
What is the difference between a Hyperparameter and a Parameter?
Approach: Compare internal learned values with external configuration values.
Parameters are internal to the model and learned from the data (e.g., weights in a neural network). Hyperparameters are external configurations set by the practitioner before training (e.g., learning rate, K in K-means).
Follow-up: How do you optimize hyperparameters?
Key concepts: weights, learning rate, training.