Large Language Models
157 views
Autoregressive Model
Quick Definition
Generative model predicting next token from previous tokens
Full Definition
A generative model predicting the next token based on all previous tokens in sequence.
Examples
GPT text generation, language modeling, next-token prediction
Related Terms
large-language-model
transformer
More Large Language Models Terms
Alignment Tax
Performance cost of aligning AI with human preferences
Inference LLM
Using a trained LLM to generate outputs from inputs
Multi-Head Attention
Parallel attention operations concatenated for richer representations
Model Merging
Combining fine-tuned LLMs without additional training
Large Language Model
Massive AI model trained on text for language understanding and generation
Embeddings LLM
Dense vectors capturing semantic meaning of text