Transformer
Quick Definition
Architecture using self-attention for parallel processing
Full Definition
A neural network architecture using self-attention mechanisms for parallel processing of sequential data.
Examples
GPT, BERT, Vision Transformer
Related Terms
self-attention
large-language-model
More Artificial Intelligence Terms
AI Alignment
Ensuring AI systems act in accordance with human values
Embedding
Learned vector representations of discrete objects in continuous space
Synthetic Data
Artificially generated data mimicking real-world distributions
Prompt Injection
Attack manipulating AI behavior by overriding instructions
Bag of Words
Text model representing documents by word frequency counts
AI Governance
Framework for responsible AI development policies