Large Language Models
21 views
Top-K Sampling
Quick Definition
Generation strategy considering top k most probable tokens
Full Definition
A generation strategy considering only the top k most probable tokens at each step.
Examples
text generation, creative writing, chatbot responses
Related Terms
nucleus-sampling
temperature
beam-search
More Large Language Models Terms
WordPiece
Subword tokenization splitting words into frequent units
PEFT
Fine-tuning methods updating only small parameter subsets
Beam Search
Search algorithm exploring multiple output sequences
BPE
Subword tokenization algorithm merging frequent character pairs
Positional Encoding
Incorporating token position information into transformers
Chain-of-Thought Prompting
Technique encouraging step-by-step reasoning in LLMs