Large Language Models
275 views
Mistral
Quick Definition
Efficient open-source LLMs with strong performance
Full Definition
Efficient open-source LLMs by Mistral AI known for strong performance relative to size.
Examples
Mixtral MoE, efficient inference, open-source deployment
Related Terms
large-language-model
mixture-of-experts
More Large Language Models Terms
Grounding LLM
Connecting LLM outputs to verifiable external sources
Speculative Decoding
Using draft model candidates verified by large model
DPO
Alignment method bypassing reward model for preference learning
Semantic Search
Search technique understanding meaning rather than keywords
Fine-Tuning
Further training pre-trained models on specific domain data
Scaling Laws
Relationships between model size, data, compute, and performance