Large Language Models
348 views
Instruction Tuning
Quick Definition
Fine-tuning on instruction-response pairs for better following
Full Definition
Fine-tuning models on instruction-response pairs to improve instruction following ability.
Examples
chatbot training, assistant development, task alignment
Related Terms
fine-tuning
rlhf
alignment
More Large Language Models Terms
Pre-training
Initial training learning general language patterns from text
Streaming
Sending LLM tokens to clients as they are generated
Llama
Meta AI's open-source large language models
Structured Output
Generating LLM responses in predefined machine-readable formats
DPO
Alignment method bypassing reward model for preference learning
Top-K Sampling
Generation strategy considering top k most probable tokens