Large Language Models
31 views
Temperature
Quick Definition
Parameter controlling randomness in text generation
Full Definition
A parameter controlling randomness in LLM outputs by scaling logits before sampling.
Examples
creative writing, deterministic output, sampling strategy
Related Terms
top-k-sampling
nucleus-sampling
More Large Language Models Terms
Attention Head
Individual attention mechanism learning specific patterns
Linear Attention
Attention with linear complexity for long sequences
Semantic Search
Search technique understanding meaning rather than keywords
Training LLM
Adjusting parameters on large datasets to learn language
Context Window
Maximum tokens a language model can process at once
Sliding Window Attention
Attention limiting tokens to nearby window only