Artificial Intelligence
302 views
Self-Attention
Quick Definition
Mechanism allowing sequence positions to attend to all others
Full Definition
A mechanism allowing each position in a sequence to attend to all positions in the same sequence.
Examples
transformer layers, contextual embeddings, parallel processing
Related Terms
transformer
attention-mechanism
More Artificial Intelligence Terms
Prompt Injection
Attack manipulating AI behavior by overriding instructions
Named Entity Recognition
Identifying and classifying named entities in text
Meta-Learning
Designing models that learn how to learn new tasks
Embedding
Learned vector representations of discrete objects in continuous space
Transformer
Architecture using self-attention for parallel processing
AI Fairness
Ensuring AI decisions do not discriminate against groups