Large Language Models
272 views
Top-K Sampling
Quick Definition
Generation strategy considering top k most probable tokens
Full Definition
A generation strategy considering only the top k most probable tokens at each step.
Examples
text generation, creative writing, chatbot responses
Related Terms
nucleus-sampling
temperature
beam-search
More Large Language Models Terms
System Prompt
Special prompt defining AI assistant behavior and constraints
Tokenizer Vocabulary
Complete set of tokens a language model can process
QLoRA
Combining 4-bit quantization with LoRA for efficiency
SentencePiece
Language-agnostic tokenizer operating on raw text bytes
Tree-of-Thought
Framework exploring multiple reasoning paths for optimal solutions
Reward Model
Model scoring LLM outputs based on human preferences