Large Language Models
269 views
Nucleus Sampling
Quick Definition
Generation using cumulative probability threshold for token selection
Full Definition
A generation strategy using cumulative probability threshold p for dynamic token selection.
Examples
natural text generation, conversation, creative content
Related Terms
top-k-sampling
temperature
beam-search
More Large Language Models Terms
Function Calling
Structured mechanism for LLMs to generate API function calls
RoPE
Position encoding using rotation matrices for relative positions
PEFT
Fine-tuning methods updating only small parameter subsets
Mixture of Experts
Architecture routing tokens to specialized expert sub-networks
Context Window
Maximum tokens a language model can process at once
Sliding Window Attention
Attention limiting tokens to nearby window only