Large Language Models
23 views
Linear Attention
Quick Definition
Attention with linear complexity for long sequences
Full Definition
Attention mechanism with linear complexity for efficient long-sequence processing.
Examples
efficient transformers, long documents, streaming models
Related Terms
attention-mechanism
sparse-attention
More Large Language Models Terms
KV Cache
Memory optimization storing key-values for faster generation
Mistral
Efficient open-source LLMs with strong performance
WordPiece
Subword tokenization splitting words into frequent units
Function Calling
Structured mechanism for LLMs to generate API function calls
Llama
Meta AI's open-source large language models
System Prompt
Special prompt defining AI assistant behavior and constraints