Machine Learning
299 views
Learning Rate
Quick Definition
Hyperparameter controlling gradient descent step size
Full Definition
A hyperparameter controlling the step size during gradient descent optimization of model parameters.
Examples
training speed, convergence, learning rate scheduling, warmup
Related Terms
gradient-descent
hyperparameter-tuning
More Machine Learning Terms
Time Series Analysis
Analyzing time-ordered data for patterns and forecasting
Regularization
Techniques constraining model complexity to prevent overfitting
CatBoost
Gradient boosting library with native categorical feature support
Random Forest
Ensemble of decision trees that votes on predictions
Hidden Markov Model
Statistical model with hidden states and observable outputs
Margin
Distance between decision boundary and nearest data points