Large Language Models
286 views
Inference LLM
Quick Definition
Using a trained LLM to generate outputs from inputs
Full Definition
The process of using a trained LLM to generate outputs from new inputs.
Examples
text generation, chat responses, content creation
Related Terms
training
inference-optimization
More Large Language Models Terms
System Prompt
Special prompt defining AI assistant behavior and constraints
Hallucination LLM
LLMs generating plausible but incorrect information
Attention Head
Individual attention mechanism learning specific patterns
Guardrails LLM
Frameworks for monitoring and controlling LLM I/O
Temperature
Parameter controlling randomness in text generation
Chain-of-Thought Prompting
Technique encouraging step-by-step reasoning in LLMs