Large Language Models
32 views
Synthetic Data Generation
Quick Definition
Using AI to create artificial training data replicating patterns
Full Definition
Using AI models to create artificial training data that replicates real data patterns and distributions.
Examples
data augmentation, privacy-safe datasets, domain adaptation
Related Terms
synthetic-data
generative-ai
data-augmentation
More Large Language Models Terms
Mixture of Experts
Architecture routing tokens to specialized expert sub-networks
Multi-Head Attention
Parallel attention operations concatenated for richer representations
Top-K Sampling
Generation strategy considering top k most probable tokens
Large Language Model
Massive AI model trained on text for language understanding and generation
Sliding Window Attention
Attention limiting tokens to nearby window only
Structured Output
Generating LLM responses in predefined machine-readable formats