Large Language Models
130 views
GGUF
Quick Definition
File format for LLMs optimized for local inference
Full Definition
GPT-Generated Unified Format, a file format for LLMs optimized for local CPU/GPU inference.
Examples
llama.cpp, local AI, quantized model distribution
Related Terms
quantization
llama
local-inference
More Large Language Models Terms
Synthetic Data Generation
Using AI to create artificial training data replicating patterns
Llama
Meta AI's open-source large language models
Fine-Tuning
Further training pre-trained models on specific domain data
RLHF
Aligning LLMs with human preferences using reinforcement learning
Structured Output
Generating LLM responses in predefined machine-readable formats
Next Token Prediction
Core LLM objective predicting the next token from context