GPT
Quick Definition
OpenAI's family of autoregressive large language models
Full Definition
Generative Pre-trained Transformer, a family of autoregressive large language models by OpenAI.
Examples
ChatGPT, GPT-4, code generation, content creation
Related Terms
transformer
large-language-model
More Large Language Models Terms
Inference LLM
Using a trained LLM to generate outputs from inputs
Training LLM
Adjusting parameters on large datasets to learn language
Top-K Sampling
Generation strategy considering top k most probable tokens
Scaling Laws
Relationships between model size, data, compute, and performance
System Prompt
Special prompt defining AI assistant behavior and constraints
SentencePiece
Language-agnostic tokenizer operating on raw text bytes