Large Language Models
135 views
Mistral
Quick Definition
Efficient open-source LLMs with strong performance
Full Definition
Efficient open-source LLMs by Mistral AI known for strong performance relative to size.
Examples
Mixtral MoE, efficient inference, open-source deployment
Related Terms
large-language-model
mixture-of-experts
More Large Language Models Terms
WordPiece
Subword tokenization splitting words into frequent units
Reward Model
Model scoring LLM outputs based on human preferences
RLHF
Aligning LLMs with human preferences using reinforcement learning
Tokenization
Breaking text into tokens for language model processing
Model Merging
Combining fine-tuned LLMs without additional training
Masked Language Model
Training objective predicting randomly masked input tokens