Gradient Boosting
Quick Definition
Sequential ensemble method correcting previous model errors
Full Definition
An ensemble technique building models sequentially where each corrects errors of previous ones.
Examples
XGBoost, LightGBM, Kaggle competitions
Related Terms
ensemble-learning
random-forest
decision-tree
More Machine Learning Terms
Gaussian Mixture Model
Probabilistic model using multiple Gaussian distributions
Markov Chain
Stochastic model where events depend only on previous state
Gradient Descent
Optimization algorithm minimizing loss by steepest descent
Feature Engineering
Creating and transforming input variables to improve performance
Time Series Analysis
Analyzing time-ordered data for patterns and forecasting
Batch Normalization
Normalizing layer inputs to stabilize and speed up training