Machine Learning
301 views
Bayesian Optimization
Quick Definition
Optimizing expensive functions using a probabilistic model
Full Definition
A strategy for optimizing expensive functions using a probabilistic surrogate model.
Examples
hyperparameter tuning, experimental design, NAS
Related Terms
hyperparameter-tuning
gaussian-process
More Machine Learning Terms
Bagging
Training models on random subsets and averaging predictions
Gradient Descent
Optimization algorithm minimizing loss by steepest descent
Bias-Variance Tradeoff
The tension between model simplicity and complexity errors
Boosting
Sequentially combining weak learners correcting previous errors
Overfitting
When a model learns training data noise and fails on new data
Linear Regression
Modeling variable relationships by fitting a linear equation