Context Window
Quick Definition
Maximum tokens a language model can process at once
Full Definition
The maximum number of tokens a language model can process in a single input.
Examples
long document processing, conversation history, retrieval context
Related Terms
large-language-model
attention
More Large Language Models Terms
System Prompt
Special prompt defining AI assistant behavior and constraints
RoPE
Position encoding using rotation matrices for relative positions
Top-K Sampling
Generation strategy considering top k most probable tokens
RAG
Enhancing LLMs by retrieving relevant external knowledge
Tokenization
Breaking text into tokens for language model processing
Jailbreaking
Circumventing AI safety restrictions through prompt techniques