Flash Attention
Quick Definition
Memory-efficient attention using GPU SRAM block computation
Full Definition
An optimized attention algorithm computing in GPU SRAM blocks for reduced memory and increased speed.
Examples
fast training, memory optimization, transformer acceleration
Related Terms
attention-mechanism
gpu-optimization
More Large Language Models Terms
Grounded Generation
Generating outputs faithful to provided source documents
Autoregressive Model
Generative model predicting next token from previous tokens
Synthetic Data Generation
Using AI to create artificial training data replicating patterns
Adapter Layer
Small trainable modules in frozen transformer layers
Tool Use
Capability of LLMs to call external tools and APIs
Instruction Tuning
Fine-tuning on instruction-response pairs for better following