Large Language Models
31 views
Adapter Layer
Quick Definition
Small trainable modules in frozen transformer layers
Full Definition
Small trainable modules inserted between frozen transformer layers for parameter-efficient fine-tuning.
Examples
efficient fine-tuning, multi-task learning, modular adaptation
Related Terms
peft
lora
fine-tuning
More Large Language Models Terms
Instruction Tuning
Fine-tuning on instruction-response pairs for better following
BPE
Subword tokenization algorithm merging frequent character pairs
System Prompt
Special prompt defining AI assistant behavior and constraints
SentencePiece
Language-agnostic tokenizer operating on raw text bytes
Scaling Laws
Relationships between model size, data, compute, and performance
Jailbreaking
Circumventing AI safety restrictions through prompt techniques