Large Language Models
222 views
Model Merging
Quick Definition
Combining fine-tuned LLMs without additional training
Full Definition
Combining multiple fine-tuned LLMs into a single model without additional training.
Examples
model soup, weight merging, multi-task models
Related Terms
fine-tuning
ensemble
More Large Language Models Terms
Top-K Sampling
Generation strategy considering top k most probable tokens
Chain-of-Thought Prompting
Technique encouraging step-by-step reasoning in LLMs
Attention Head
Individual attention mechanism learning specific patterns
GGUF
File format for LLMs optimized for local inference
Semantic Search
Search technique understanding meaning rather than keywords
Reward Model
Model scoring LLM outputs based on human preferences