Large Language Models
282 views
Embeddings LLM
Quick Definition
Dense vectors capturing semantic meaning of text
Full Definition
Dense vector representations of text capturing semantic meaning generated by language models.
Examples
semantic search, similarity comparison, clustering
Related Terms
embedding
vector-database
More Large Language Models Terms
Tokenization
Breaking text into tokens for language model processing
SentencePiece
Language-agnostic tokenizer operating on raw text bytes
Guardrails LLM
Frameworks for monitoring and controlling LLM I/O
Speculative Decoding
Using draft model candidates verified by large model
KV Cache
Memory optimization storing key-values for faster generation
BPE
Subword tokenization algorithm merging frequent character pairs