Large Language Models
261 views
Beam Search
Quick Definition
Search algorithm exploring multiple output sequences
Full Definition
A search algorithm exploring multiple output sequences to find the most likely result.
Examples
machine translation, summarization, speech recognition
Related Terms
greedy-decoding
language-modeling
More Large Language Models Terms
RoPE
Position encoding using rotation matrices for relative positions
BPE
Subword tokenization algorithm merging frequent character pairs
Inference LLM
Using a trained LLM to generate outputs from inputs
Fine-Tuning
Further training pre-trained models on specific domain data
Guardrails LLM
Frameworks for monitoring and controlling LLM I/O
Autoregressive Model
Generative model predicting next token from previous tokens