Large Language Models
32 views
Mistral
Quick Definition
Efficient open-source LLMs with strong performance
Full Definition
Efficient open-source LLMs by Mistral AI known for strong performance relative to size.
Examples
Mixtral MoE, efficient inference, open-source deployment
Related Terms
large-language-model
mixture-of-experts
More Large Language Models Terms
Flash Attention
Memory-efficient attention using GPU SRAM block computation
Reward Model
Model scoring LLM outputs based on human preferences
Adapter Layer
Small trainable modules in frozen transformer layers
Attention Head
Individual attention mechanism learning specific patterns
Tree-of-Thought
Framework exploring multiple reasoning paths for optimal solutions
Tokenization
Breaking text into tokens for language model processing