Large Language Models
38 views
Structured Output
Quick Definition
Generating LLM responses in predefined machine-readable formats
Full Definition
The ability of LLMs to generate responses in predefined formats like JSON or XML.
Examples
JSON mode, schema enforcement, API responses
Related Terms
function-calling
json-mode
More Large Language Models Terms
KV Cache
Memory optimization storing key-values for faster generation
Attention Head
Individual attention mechanism learning specific patterns
System Prompt
Special prompt defining AI assistant behavior and constraints
Masked Language Model
Training objective predicting randomly masked input tokens
Tool Use
Capability of LLMs to call external tools and APIs
Streaming
Sending LLM tokens to clients as they are generated