Large Language Models
27 views
Prompt Template
Quick Definition
Reusable structured format with dynamic input placeholders
Full Definition
A reusable structured text format with placeholders for dynamic inputs to guide LLM responses consistently.
Examples
system prompts, few-shot templates, task-specific formats
Related Terms
prompt-engineering
system-prompt
More Large Language Models Terms
KV Cache
Memory optimization storing key-values for faster generation
RoPE
Position encoding using rotation matrices for relative positions
Prompt Caching
Storing key-value states for repeated prompt prefixes
Top-K Sampling
Generation strategy considering top k most probable tokens
Function Calling
Structured mechanism for LLMs to generate API function calls
Speculative Decoding
Using draft model candidates verified by large model