Machine Learning
144 views
Gradient Descent
Quick Definition
Optimization algorithm minimizing loss by steepest descent
Full Definition
An optimization algorithm minimizing a loss function by moving in the direction of steepest descent.
Examples
neural network training, parameter optimization, loss minimization
Related Terms
backpropagation
learning-rate
optimization
More Machine Learning Terms
Feature Selection
Identifying the most relevant features for model training
Decision Tree
Tree-like model splitting data based on feature values
Multi-Task Learning
Training one model for multiple related tasks simultaneously
Confusion Matrix
Table visualizing classifier performance by class predictions
CatBoost
Gradient boosting library with native categorical feature support
Loss Function
Math function measuring prediction vs actual value difference