Large Language Models
151 views
Adapter Layer
Quick Definition
Small trainable modules in frozen transformer layers
Full Definition
Small trainable modules inserted between frozen transformer layers for parameter-efficient fine-tuning.
Examples
efficient fine-tuning, multi-task learning, modular adaptation
Related Terms
peft
lora
fine-tuning
More Large Language Models Terms
Guardrails LLM
Frameworks for monitoring and controlling LLM I/O
Vector Database
Specialized database for high-dimensional embedding queries
Structured Output
Generating LLM responses in predefined machine-readable formats
Alignment Tax
Performance cost of aligning AI with human preferences
Prompt Template
Reusable structured format with dynamic input placeholders
Inference LLM
Using a trained LLM to generate outputs from inputs