Machine Learning
148 views
Learning Rate
Quick Definition
Hyperparameter controlling gradient descent step size
Full Definition
A hyperparameter controlling the step size during gradient descent optimization of model parameters.
Examples
training speed, convergence, learning rate scheduling, warmup
Related Terms
gradient-descent
hyperparameter-tuning
More Machine Learning Terms
Ensemble Learning
Combining multiple models for better predictions
Kernel Trick
Transforming data to higher dimensions for linear separability
Gradient Descent
Optimization algorithm minimizing loss by steepest descent
Feature Engineering
Creating and transforming input variables to improve performance
Model Selection
Choosing the best ML model from candidates
ROC Curve
Plot showing classifier performance across thresholds