RAG
Quick Definition
Enhancing LLMs by retrieving relevant external knowledge
Full Definition
Retrieval-Augmented Generation enhancing LLM responses by retrieving relevant external knowledge.
Examples
enterprise search, knowledge chatbots, document QA
Related Terms
vector-database
semantic-search
More Large Language Models Terms
Synthetic Data Generation
Using AI to create artificial training data replicating patterns
Next Token Prediction
Core LLM objective predicting the next token from context
Speculative Decoding
Using draft model candidates verified by large model
DPO
Alignment method bypassing reward model for preference learning
Model Merging
Combining fine-tuned LLMs without additional training
Alignment Tax
Performance cost of aligning AI with human preferences