Large Language Models
150 views
Inference LLM
Quick Definition
Using a trained LLM to generate outputs from inputs
Full Definition
The process of using a trained LLM to generate outputs from new inputs.
Examples
text generation, chat responses, content creation
Related Terms
training
inference-optimization
More Large Language Models Terms
Tokenization
Breaking text into tokens for language model processing
Instruction Tuning
Fine-tuning on instruction-response pairs for better following
Guardrails LLM
Frameworks for monitoring and controlling LLM I/O
RAG
Enhancing LLMs by retrieving relevant external knowledge
Pre-training
Initial training learning general language patterns from text
Autoregressive Model
Generative model predicting next token from previous tokens