RLHF
Quick Definition
Aligning LLMs with human preferences using reinforcement learning
Full Definition
Reinforcement Learning from Human Feedback aligning language models with human preferences.
Examples
ChatGPT alignment, preference learning, safety tuning
Related Terms
reinforcement-learning
reward-model
alignment
More Large Language Models Terms
Flash Attention
Memory-efficient attention using GPU SRAM block computation
Mixture of Experts
Architecture routing tokens to specialized expert sub-networks
Training LLM
Adjusting parameters on large datasets to learn language
SentencePiece
Language-agnostic tokenizer operating on raw text bytes
Multi-Head Attention
Parallel attention operations concatenated for richer representations
Llama
Meta AI's open-source large language models