Fine-Tuning
Quick Definition
Further training pre-trained models on specific domain data
Full Definition
Further training a pre-trained language model on domain-specific or task-specific data.
Examples
domain adaptation, instruction tuning, task specialization
Related Terms
transfer-learning
lora
pre-training
More Large Language Models Terms
Pre-training
Initial training learning general language patterns from text
PEFT
Fine-tuning methods updating only small parameter subsets
Multi-Head Attention
Parallel attention operations concatenated for richer representations
Tokenization
Breaking text into tokens for language model processing
Autoregressive Model
Generative model predicting next token from previous tokens
DPO
Alignment method bypassing reward model for preference learning