Large Language Models
158 views
QLoRA
Quick Definition
Combining 4-bit quantization with LoRA for efficiency
Full Definition
Combining 4-bit quantization with LoRA for memory-efficient fine-tuning of large models.
Examples
consumer GPU fine-tuning, large model adaptation
Related Terms
lora
quantization
fine-tuning
More Large Language Models Terms
Attention Head
Individual attention mechanism learning specific patterns
Structured Output
Generating LLM responses in predefined machine-readable formats
Sparse Attention
Attention attending to only a subset of tokens
Llama
Meta AI's open-source large language models
Grounding LLM
Connecting LLM outputs to verifiable external sources
Semantic Search
Search technique understanding meaning rather than keywords