Gradient Boosting
Quick Definition
Sequential ensemble method correcting previous model errors
Full Definition
An ensemble technique building models sequentially where each corrects errors of previous ones.
Examples
XGBoost, LightGBM, Kaggle competitions
Related Terms
ensemble-learning
random-forest
decision-tree
More Machine Learning Terms
Feature Selection
Identifying the most relevant features for model training
Regularization
Techniques constraining model complexity to prevent overfitting
Survival Analysis
Statistical methods analyzing time until an event occurs
Ensemble Learning
Combining multiple models for better predictions
UMAP
Fast dimensionality reduction preserving local and global structure
Polynomial Regression
Extending linear models with polynomial features for nonlinear data