Large Language Models
21 views
Training LLM
Quick Definition
Adjusting parameters on large datasets to learn language
Full Definition
Adjusting model parameters on large datasets to learn language patterns through optimization.
Examples
pre-training, fine-tuning, RLHF
Related Terms
pre-training
fine-tuning
gradient-descent
More Large Language Models Terms
KV Cache
Memory optimization storing key-values for faster generation
BERT
Google's bidirectional transformer for context understanding
Chain-of-Thought Prompting
Technique encouraging step-by-step reasoning in LLMs
Mistral
Efficient open-source LLMs with strong performance
Tokenizer Vocabulary
Complete set of tokens a language model can process
System Prompt
Special prompt defining AI assistant behavior and constraints