Artificial Intelligence
153 views
Model Distillation
Quick Definition
Creating smaller models that replicate larger model behavior
Full Definition
Creating smaller models that replicate the behavior of larger teacher models for efficient deployment.
Examples
TinyBERT, mobile models, edge deployment
Related Terms
pruning
quantization
model-compression
More Artificial Intelligence Terms
AI Ethics
Study of moral implications in AI development
Prompt Engineering
Crafting effective inputs to guide AI model outputs
Neural Architecture Search
Automating the design of optimal neural network architectures
Named Entity Recognition
Identifying and classifying named entities in text
Meta-Learning
Designing models that learn how to learn new tasks
Embedding
Learned vector representations of discrete objects in continuous space