Large Language Models
142 views
Beam Search
Quick Definition
Search algorithm exploring multiple output sequences
Full Definition
A search algorithm exploring multiple output sequences to find the most likely result.
Examples
machine translation, summarization, speech recognition
Related Terms
greedy-decoding
language-modeling
More Large Language Models Terms
Adapter Layer
Small trainable modules in frozen transformer layers
WordPiece
Subword tokenization splitting words into frequent units
Fine-Tuning
Further training pre-trained models on specific domain data
Quantization LLM
Reducing LLM weight precision for efficient inference
Speculative Decoding
Using draft model candidates verified by large model
Linear Attention
Attention with linear complexity for long sequences