Large Language Models
282 views
WordPiece
Quick Definition
Subword tokenization splitting words into frequent units
Full Definition
A subword tokenization algorithm that splits words into frequent subword units based on likelihood.
Examples
BERT tokenization, vocabulary building, unknown word handling
Related Terms
tokenization
bpe
sentencepiece
More Large Language Models Terms
PEFT
Fine-tuning methods updating only small parameter subsets
Top-K Sampling
Generation strategy considering top k most probable tokens
Semantic Search
Search technique understanding meaning rather than keywords
Grounding LLM
Connecting LLM outputs to verifiable external sources
Quantization LLM
Reducing LLM weight precision for efficient inference
BERT
Google's bidirectional transformer for context understanding