Large Language Models
284 views
Linear Attention
Quick Definition
Attention with linear complexity for long sequences
Full Definition
Attention mechanism with linear complexity for efficient long-sequence processing.
Examples
efficient transformers, long documents, streaming models
Related Terms
attention-mechanism
sparse-attention
More Large Language Models Terms
Top-K Sampling
Generation strategy considering top k most probable tokens
Prompt Template
Reusable structured format with dynamic input placeholders
Alignment Tax
Performance cost of aligning AI with human preferences
Reward Model
Model scoring LLM outputs based on human preferences
Jailbreaking
Circumventing AI safety restrictions through prompt techniques
Synthetic Data Generation
Using AI to create artificial training data replicating patterns