Large Language Models
22 views
BPE
Quick Definition
Subword tokenization algorithm merging frequent character pairs
Full Definition
Byte-Pair Encoding, a subword tokenization algorithm iteratively merging frequent character pairs.
Examples
GPT tokenization, vocabulary building, subword splitting
Related Terms
tokenization
vocabulary
More Large Language Models Terms
Adapter Layer
Small trainable modules in frozen transformer layers
Tool Use
Capability of LLMs to call external tools and APIs
DPO
Alignment method bypassing reward model for preference learning
Llama
Meta AI's open-source large language models
Tokenization
Breaking text into tokens for language model processing
Model Merging
Combining fine-tuned LLMs without additional training