Large Language Models
32 views
Autoregressive Model
Quick Definition
Generative model predicting next token from previous tokens
Full Definition
A generative model predicting the next token based on all previous tokens in sequence.
Examples
GPT text generation, language modeling, next-token prediction
Related Terms
large-language-model
transformer
More Large Language Models Terms
Tree-of-Thought
Framework exploring multiple reasoning paths for optimal solutions
Embeddings LLM
Dense vectors capturing semantic meaning of text
Next Token Prediction
Core LLM objective predicting the next token from context
Multi-Head Attention
Parallel attention operations concatenated for richer representations
Distillation LLM
Training smaller LLMs to replicate larger model behavior
Tool Use
Capability of LLMs to call external tools and APIs