Artificial Intelligence
155 views
Quantization
Quick Definition
Reducing model precision from 32-bit to lower bit representations
Full Definition
Reducing model size and computation by representing weights with lower precision numbers like INT8.
Examples
INT8 inference, mixed precision, PTQ
Related Terms
pruning
model-distillation
More Artificial Intelligence Terms
Chain-of-Thought
Technique encouraging AI to show step-by-step reasoning
OCR
Technology converting images of text into machine-readable text
Responsible AI
Framework for developing fair, transparent, accountable AI
AutoML
Automation of the machine learning pipeline
AI Benchmark
Standardized tests measuring AI model performance
State Space Model
Architecture using linear attention for efficient sequence modeling