Large Language Models
282 views
Training LLM
Quick Definition
Adjusting parameters on large datasets to learn language
Full Definition
Adjusting model parameters on large datasets to learn language patterns through optimization.
Examples
pre-training, fine-tuning, RLHF
Related Terms
pre-training
fine-tuning
gradient-descent
More Large Language Models Terms
KV Cache
Memory optimization storing key-values for faster generation
Prompt Template
Reusable structured format with dynamic input placeholders
Alignment Tax
Performance cost of aligning AI with human preferences
Streaming
Sending LLM tokens to clients as they are generated
Tokenizer Vocabulary
Complete set of tokens a language model can process
Tokenization
Breaking text into tokens for language model processing