Large Language Models
25 views
Beam Search
Quick Definition
Search algorithm exploring multiple output sequences
Full Definition
A search algorithm exploring multiple output sequences to find the most likely result.
Examples
machine translation, summarization, speech recognition
Related Terms
greedy-decoding
language-modeling
More Large Language Models Terms
Scaling Laws
Relationships between model size, data, compute, and performance
Multi-Head Attention
Parallel attention operations concatenated for richer representations
Tool Use
Capability of LLMs to call external tools and APIs
Attention Head
Individual attention mechanism learning specific patterns
RLHF
Aligning LLMs with human preferences using reinforcement learning
Masked Language Model
Training objective predicting randomly masked input tokens