Flash Attention
Quick Definition
Memory-efficient attention using GPU SRAM block computation
Full Definition
An optimized attention algorithm computing in GPU SRAM blocks for reduced memory and increased speed.
Examples
fast training, memory optimization, transformer acceleration
Related Terms
attention-mechanism
gpu-optimization
More Large Language Models Terms
Function Calling
Structured mechanism for LLMs to generate API function calls
Jailbreaking
Circumventing AI safety restrictions through prompt techniques
Chain-of-Thought Prompting
Technique encouraging step-by-step reasoning in LLMs
PEFT
Fine-tuning methods updating only small parameter subsets
Next Token Prediction
Core LLM objective predicting the next token from context
Instruction Tuning
Fine-tuning on instruction-response pairs for better following