Large Language Models
259 views
Constitutional AI
Quick Definition
Training AI to follow explicit principles for consistency
Full Definition
Training AI to follow explicit principles or a constitution for consistent helpful behavior.
Examples
principle-based alignment, self-critique, safety training
Related Terms
ai-alignment
rlhf
responsible-ai
More Large Language Models Terms
Flash Attention
Memory-efficient attention using GPU SRAM block computation
Autoregressive Model
Generative model predicting next token from previous tokens
WordPiece
Subword tokenization splitting words into frequent units
Top-K Sampling
Generation strategy considering top k most probable tokens
Next Token Prediction
Core LLM objective predicting the next token from context
BERT
Google's bidirectional transformer for context understanding