Large Language Models
259 views
Next Token Prediction
Quick Definition
Core LLM objective predicting the next token from context
Full Definition
The core training objective of autoregressive LLMs predicting the most probable next token given previous context.
Examples
GPT text generation, autocomplete, language modeling
Related Terms
autoregressive-model
large-language-model
pre-training
More Large Language Models Terms
LoRA
Parameter-efficient fine-tuning using low-rank matrix decomposition
Function Calling
Structured mechanism for LLMs to generate API function calls
Large Language Model
Massive AI model trained on text for language understanding and generation
PEFT
Fine-tuning methods updating only small parameter subsets
GPT
OpenAI's family of autoregressive large language models
Pre-training
Initial training learning general language patterns from text