Large Language Models
304 views
QLoRA
Quick Definition
Combining 4-bit quantization with LoRA for efficiency
Full Definition
Combining 4-bit quantization with LoRA for memory-efficient fine-tuning of large models.
Examples
consumer GPU fine-tuning, large model adaptation
Related Terms
lora
quantization
fine-tuning
More Large Language Models Terms
GGUF
File format for LLMs optimized for local inference
Prompt Caching
Storing key-value states for repeated prompt prefixes
WordPiece
Subword tokenization splitting words into frequent units
Large Language Model
Massive AI model trained on text for language understanding and generation
Training LLM
Adjusting parameters on large datasets to learn language
RLHF
Aligning LLMs with human preferences using reinforcement learning