Artificial Intelligence
305 views
Quantization
Quick Definition
Reducing model precision from 32-bit to lower bit representations
Full Definition
Reducing model size and computation by representing weights with lower precision numbers like INT8.
Examples
INT8 inference, mixed precision, PTQ
Related Terms
pruning
model-distillation
More Artificial Intelligence Terms
State Space Model
Architecture using linear attention for efficient sequence modeling
AI Alignment
Ensuring AI systems act in accordance with human values
Knowledge Graph
Structured graph of entities and their relationships
Explainable AI
AI that provides understandable explanations for decisions
Transfer Learning
Adapting a pre-trained model for a different related task
AutoML
Automation of the machine learning pipeline