Artificial Intelligence
156 views
Attention Mechanism
Quick Definition
Component allowing models to focus on relevant input parts
Full Definition
A neural network component that allows models to focus on relevant parts of the input when producing output.
Examples
self-attention, cross-attention, multi-head attention
Related Terms
transformer
self-attention
More Artificial Intelligence Terms
One-Shot Learning
Learning to recognize patterns from a single example
Prompt Injection
Attack manipulating AI behavior by overriding instructions
AI Benchmark
Standardized tests measuring AI model performance
Speech Synthesis
Converting written text into natural-sounding spoken audio
Variational Autoencoder
Generative model using latent space encoding and decoding
Chain-of-Thought
Technique encouraging AI to show step-by-step reasoning