Fine-Tuning
Quick Definition
Further training pre-trained models on specific domain data
Full Definition
Further training a pre-trained language model on domain-specific or task-specific data.
Examples
domain adaptation, instruction tuning, task specialization
Related Terms
transfer-learning
lora
pre-training
More Large Language Models Terms
Autoregressive Model
Generative model predicting next token from previous tokens
Hallucination LLM
LLMs generating plausible but incorrect information
Constitutional AI
Training AI to follow explicit principles for consistency
Streaming
Sending LLM tokens to clients as they are generated
Speculative Decoding
Using draft model candidates verified by large model
Mistral
Efficient open-source LLMs with strong performance