Attention Mechanism

Quick Definition

Component allowing models to focus on relevant input parts

A neural network component that allows models to focus on relevant parts of the input when producing output.

self-attention, cross-attention, multi-head attention

transformer self-attention

Architecture using self-attention for parallel processing

Attack manipulating AI behavior by overriding instructions

Crafting effective inputs to guide AI model outputs

AI that processes and integrates multiple data types

NLP technique determining emotional tone in text

AI field enabling computers to understand human language