Large Language Models
25 views
QLoRA
Quick Definition
Combining 4-bit quantization with LoRA for efficiency
Full Definition
Combining 4-bit quantization with LoRA for memory-efficient fine-tuning of large models.
Examples
consumer GPU fine-tuning, large model adaptation
Related Terms
lora
quantization
fine-tuning
More Large Language Models Terms
Scaling Laws
Relationships between model size, data, compute, and performance
RLHF
Aligning LLMs with human preferences using reinforcement learning
Jailbreaking
Circumventing AI safety restrictions through prompt techniques
Grounded Generation
Generating outputs faithful to provided source documents
Nucleus Sampling
Generation using cumulative probability threshold for token selection
WordPiece
Subword tokenization splitting words into frequent units