RLHF
Quick Definition
Aligning LLMs with human preferences using reinforcement learning
Full Definition
Reinforcement Learning from Human Feedback aligning language models with human preferences.
Examples
ChatGPT alignment, preference learning, safety tuning
Related Terms
reinforcement-learning
reward-model
alignment
More Large Language Models Terms
Model Merging
Combining fine-tuned LLMs without additional training
Flash Attention
Memory-efficient attention using GPU SRAM block computation
Function Calling
Structured mechanism for LLMs to generate API function calls
Multi-Head Attention
Parallel attention operations concatenated for richer representations
Instruction Tuning
Fine-tuning on instruction-response pairs for better following
Tokenization
Breaking text into tokens for language model processing