Machine Learning
270 views
Bias-Variance Tradeoff
Quick Definition
The tension between model simplicity and complexity errors
Full Definition
The tension between model error from oversimplifying bias and error from overfitting variance.
Examples
model selection, ensemble methods, hyperparameter tuning
Related Terms
overfitting
underfitting
model-complexity
More Machine Learning Terms
Gradient Boosting
Sequential ensemble method correcting previous model errors
K-Nearest Neighbors
Classifying based on majority class of k nearest neighbors
Dropout
Regularization randomly deactivating neurons during training
Bayesian Optimization
Optimizing expensive functions using a probabilistic model
Underfitting
When a model is too simple to capture data patterns
A/B Testing
Statistical method comparing two versions for performance