Machine Learning
273 views
Self-Supervised Learning
Quick Definition
Generating supervisory signals from unlabeled data for training
Full Definition
A ML approach where the model generates its own supervisory signal from unlabeled data.
Examples
BERT pre-training, contrastive learning, masked modeling
Related Terms
contrastive-learning
transfer-learning
More Machine Learning Terms
Naive Bayes
Probabilistic classifier using Bayes theorem with independence
LightGBM
Fast gradient boosting framework using histogram splitting
Confusion Matrix
Table visualizing classifier performance by class predictions
Random Forest
Ensemble of decision trees that votes on predictions
Dimensionality Reduction
Reducing feature count while preserving important information
PCA
Statistical technique reducing dimensionality via principal components