Context Window
Quick Definition
Maximum tokens a language model can process at once
Full Definition
The maximum number of tokens a language model can process in a single input.
Examples
long document processing, conversation history, retrieval context
Related Terms
large-language-model
attention
More Large Language Models Terms
Model Merging
Combining fine-tuned LLMs without additional training
Prompt Template
Reusable structured format with dynamic input placeholders
Hallucination LLM
LLMs generating plausible but incorrect information
Temperature
Parameter controlling randomness in text generation
Inference LLM
Using a trained LLM to generate outputs from inputs
System Prompt
Special prompt defining AI assistant behavior and constraints