Context Window
Quick Definition
Maximum tokens a language model can process at once
Full Definition
The maximum number of tokens a language model can process in a single input.
Examples
long document processing, conversation history, retrieval context
Related Terms
large-language-model
attention
More Large Language Models Terms
Streaming
Sending LLM tokens to clients as they are generated
Sparse Attention
Attention attending to only a subset of tokens
Llama
Meta AI's open-source large language models
Training LLM
Adjusting parameters on large datasets to learn language
Tokenizer Vocabulary
Complete set of tokens a language model can process
Chain-of-Thought Prompting
Technique encouraging step-by-step reasoning in LLMs