Large Language Models
254 views
GGUF
Quick Definition
File format for LLMs optimized for local inference
Full Definition
GPT-Generated Unified Format, a file format for LLMs optimized for local CPU/GPU inference.
Examples
llama.cpp, local AI, quantized model distribution
Related Terms
quantization
llama
local-inference
More Large Language Models Terms
Inference LLM
Using a trained LLM to generate outputs from inputs
Reward Model
Model scoring LLM outputs based on human preferences
Temperature
Parameter controlling randomness in text generation
Grounded Generation
Generating outputs faithful to provided source documents
Jailbreaking
Circumventing AI safety restrictions through prompt techniques
Constitutional AI
Training AI to follow explicit principles for consistency