Large Language Models
281 views
Guardrails LLM
Quick Definition
Frameworks for monitoring and controlling LLM I/O
Full Definition
Frameworks for monitoring and controlling LLM inputs and outputs in production.
Examples
output validation, content filtering, compliance checking
Related Terms
ai-safety
content-moderation
More Large Language Models Terms
Temperature
Parameter controlling randomness in text generation
Embeddings LLM
Dense vectors capturing semantic meaning of text
Tree-of-Thought
Framework exploring multiple reasoning paths for optimal solutions
Streaming
Sending LLM tokens to clients as they are generated
DPO
Alignment method bypassing reward model for preference learning
Top-K Sampling
Generation strategy considering top k most probable tokens