Large Language Models
32 views
Nucleus Sampling
Quick Definition
Generation using cumulative probability threshold for token selection
Full Definition
A generation strategy using cumulative probability threshold p for dynamic token selection.
Examples
natural text generation, conversation, creative content
Related Terms
top-k-sampling
temperature
beam-search
More Large Language Models Terms
KV Cache
Memory optimization storing key-values for faster generation
Large Language Model
Massive AI model trained on text for language understanding and generation
Scaling Laws
Relationships between model size, data, compute, and performance
Instruction Tuning
Fine-tuning on instruction-response pairs for better following
Chain-of-Thought Prompting
Technique encouraging step-by-step reasoning in LLMs
Top-K Sampling
Generation strategy considering top k most probable tokens