Large Language Models
141 views
Top-K Sampling
Quick Definition
Generation strategy considering top k most probable tokens
Full Definition
A generation strategy considering only the top k most probable tokens at each step.
Examples
text generation, creative writing, chatbot responses
Related Terms
nucleus-sampling
temperature
beam-search
More Large Language Models Terms
Multi-Head Attention
Parallel attention operations concatenated for richer representations
Tokenization
Breaking text into tokens for language model processing
Synthetic Data Generation
Using AI to create artificial training data replicating patterns
Prompt Template
Reusable structured format with dynamic input placeholders
LoRA
Parameter-efficient fine-tuning using low-rank matrix decomposition
Constitutional AI
Training AI to follow explicit principles for consistency