Transformer
Quick Definition
Architecture using self-attention for parallel processing
Full Definition
A neural network architecture using self-attention mechanisms for parallel processing of sequential data.
Examples
GPT, BERT, Vision Transformer
Related Terms
self-attention
large-language-model
More Artificial Intelligence Terms
AI Chip
Specialized hardware for accelerating AI computation
Multimodal AI
AI that processes and integrates multiple data types
Adversarial Attack
Crafting inputs that fool AI models into wrong predictions
Explainable AI
AI that provides understandable explanations for decisions
Embedding
Learned vector representations of discrete objects in continuous space
Symbolic AI
AI using symbolic logic and explicit knowledge rules