Large Language Models
155 views
Temperature
Quick Definition
Parameter controlling randomness in text generation
Full Definition
A parameter controlling randomness in LLM outputs by scaling logits before sampling.
Examples
creative writing, deterministic output, sampling strategy
Related Terms
top-k-sampling
nucleus-sampling
More Large Language Models Terms
Guardrails LLM
Frameworks for monitoring and controlling LLM I/O
Embeddings LLM
Dense vectors capturing semantic meaning of text
Distillation LLM
Training smaller LLMs to replicate larger model behavior
Quantization LLM
Reducing LLM weight precision for efficient inference
DPO
Alignment method bypassing reward model for preference learning
Linear Attention
Attention with linear complexity for long sequences