Large Language Models
24 views
BERT
Quick Definition
Google's bidirectional transformer for context understanding
Full Definition
Bidirectional Encoder Representations from Transformers, a Google model processing text in both directions.
Examples
search ranking, question answering, sentiment analysis
Related Terms
transformer
encoder-only
More Large Language Models Terms
BPE
Subword tokenization algorithm merging frequent character pairs
Mixture of Experts
Architecture routing tokens to specialized expert sub-networks
Guardrails LLM
Frameworks for monitoring and controlling LLM I/O
Model Merging
Combining fine-tuned LLMs without additional training
Reward Model
Model scoring LLM outputs based on human preferences
Speculative Decoding
Using draft model candidates verified by large model