Artificial Intelligence
142 views
State Space Model
Quick Definition
Architecture using linear attention for efficient sequence modeling
Full Definition
A neural network architecture using linear attention mechanisms to model sequences with constant memory usage.
Examples
Mamba, S4, long-range dependencies, efficient sequence modeling
Related Terms
transformer
recurrent-neural-network
attention-mechanism
More Artificial Intelligence Terms
Red Teaming AI
Adversarial testing of AI models for vulnerabilities
Reward Modeling
Training models to predict human preferences for RLHF
Long Short-Term Memory
RNN variant designed to learn long-term dependencies
Word Embedding
Dense vector representation capturing word semantic meaning
Multimodal AI
AI that processes and integrates multiple data types
Embedding
Learned vector representations of discrete objects in continuous space