Gradient Boosting
Quick Definition
Sequential ensemble method correcting previous model errors
Full Definition
An ensemble technique building models sequentially where each corrects errors of previous ones.
Examples
XGBoost, LightGBM, Kaggle competitions
Related Terms
ensemble-learning
random-forest
decision-tree
More Machine Learning Terms
Confusion Matrix
Table visualizing classifier performance by class predictions
Support Vector Machine
Finding optimal hyperplane to separate classes with max margin
Ridge Regression
Regularized regression using L2 penalty to prevent overfitting
Hyperparameter Tuning
Finding optimal configuration values before training
Multi-Task Learning
Training one model for multiple related tasks simultaneously
Polynomial Regression
Extending linear models with polynomial features for nonlinear data