What is 'Hyperparameter Optimization' via Bayesian Search?

What is 'Hyperparameter Optimization' via Bayesian Search?

Approach: Describe using a surrogate model to intelligently pick the next set of hyperparameters to test.

An strategy that builds a probabilistic model of the objective function (e.g., model accuracy) and uses it to select the most promising hyperparameters to evaluate next.

Follow-up: How does it compare to Grid Search in terms of speed?

Key concepts: gaussian process, acquisition function, exploration/exploitation.