Large Language Models
279 views
Distillation LLM
Quick Definition
Training smaller LLMs to replicate larger model behavior
Full Definition
Training smaller student LLMs to replicate behavior of larger teacher models.
Examples
student-teacher training, model compression, edge deployment
Related Terms
model-distillation
quantization
More Large Language Models Terms
Streaming
Sending LLM tokens to clients as they are generated
Grounding LLM
Connecting LLM outputs to verifiable external sources
Temperature
Parameter controlling randomness in text generation
Synthetic Data Generation
Using AI to create artificial training data replicating patterns
Alignment Tax
Performance cost of aligning AI with human preferences
Fine-Tuning
Further training pre-trained models on specific domain data