Artificial Intelligence
32 views
Quantization
Quick Definition
Reducing model precision from 32-bit to lower bit representations
Full Definition
Reducing model size and computation by representing weights with lower precision numbers like INT8.
Examples
INT8 inference, mixed precision, PTQ
Related Terms
pruning
model-distillation
More Artificial Intelligence Terms
Symbolic AI
AI using symbolic logic and explicit knowledge rules
Reward Modeling
Training models to predict human preferences for RLHF
Speech Synthesis
Converting written text into natural-sounding spoken audio
AI Alignment
Ensuring AI systems act in accordance with human values
Generative AI
AI systems that create new content
Adversarial Attack
Crafting inputs that fool AI models into wrong predictions