GPT
Quick Definition
OpenAI's family of autoregressive large language models
Full Definition
Generative Pre-trained Transformer, a family of autoregressive large language models by OpenAI.
Examples
ChatGPT, GPT-4, code generation, content creation
Related Terms
transformer
large-language-model
More Large Language Models Terms
Temperature
Parameter controlling randomness in text generation
Vector Database
Specialized database for high-dimensional embedding queries
PEFT
Fine-tuning methods updating only small parameter subsets
Jailbreaking
Circumventing AI safety restrictions through prompt techniques
Speculative Decoding
Using draft model candidates verified by large model
Scaling Laws
Relationships between model size, data, compute, and performance