Machine Learning
23 views
Gradient Descent
Quick Definition
Optimization algorithm minimizing loss by steepest descent
Full Definition
An optimization algorithm minimizing a loss function by moving in the direction of steepest descent.
Examples
neural network training, parameter optimization, loss minimization
Related Terms
backpropagation
learning-rate
optimization
More Machine Learning Terms
Batch Normalization
Normalizing layer inputs to stabilize and speed up training
Lasso Regression
Regularized regression using L1 penalty for feature selection
t-SNE
Nonlinear technique for visualizing high-dimensional data
Time Series Analysis
Analyzing time-ordered data for patterns and forecasting
Dropout
Regularization randomly deactivating neurons during training
Feature Selection
Identifying the most relevant features for model training