Large Language Models
301 views
Temperature
Quick Definition
Parameter controlling randomness in text generation
Full Definition
A parameter controlling randomness in LLM outputs by scaling logits before sampling.
Examples
creative writing, deterministic output, sampling strategy
Related Terms
top-k-sampling
nucleus-sampling
More Large Language Models Terms
Attention Head
Individual attention mechanism learning specific patterns
KV Cache
Memory optimization storing key-values for faster generation
Top-K Sampling
Generation strategy considering top k most probable tokens
RLHF
Aligning LLMs with human preferences using reinforcement learning
Grounding LLM
Connecting LLM outputs to verifiable external sources
Function Calling
Structured mechanism for LLMs to generate API function calls