Nomic Embed Text v1.5 is the leading open long-context embedding model — supports 8192 tokens (16x BGE-Large) and uses Matryoshka representation learning, so you can truncate the 768-dim output to 256 or 128 dims with minimal accuracy loss. Apache 2.0 licensed and trained on fully open data. Tiny 137 M footprint runs on CPU; on GPU it embeds 200k+ chunks/sec.
Nomic Embed Text v1.5 needs at minimum 0.1 GB of VRAM at Q4_K_M quantization (0.3 GB at FP16). The cheapest GPU that comfortably fits with KV-cache headroom is the Intel Arc A380 6GB (6 GB VRAM, $139 MSRP). Community benchmark submissions are open. This model fits a single consumer GPU under 48 GB, so a one-card build works.
Weights only. Add ~20-30% for KV cache at typical context lengths.
| Quant | VRAM | Quality | Notes |
|---|---|---|---|
| FP16 | 0.3 GB | Reference | Training-precision weights |
| Q8_0 | 0.2 GB | Near-lossless | 8-bit, ~0.1% perplexity hit |
| Q6_K | 0.1 GB | Very high | 6-bit, near Q8 quality |
| Q5_K_M | 0.1 GB | High | Strong middle ground |
| Q4_K_M | 0.1 GB | Balanced (recommended) | Default for local deployments |
| Q4_0 | 0.1 GB | Legacy 4-bit | Older GGUF, kept for compatibility |
| Q3_K_M | 0.1 GB | Lossy | When VRAM is very tight |
| Q2_K | 0.0 GB | Extreme | Rescue option, quality degrades visibly |
Filtered from MyAIHardware's GPU database. FP16 needs 0.3 GB; Q4_K_M needs 0.1 GB.
We don't have community benchmarks for this exact model yet.
Official weights + popular runtime tags.
ollama pull nomic-embed-textStep-by-step guides that use this model.
Models in a similar size or capability class.
Use these in papers, blog posts, or internal docs.
@misc{nomic-embed-text-v1-5-2024,
title={Nomic Embed Text v1.5},
author={Nomic AI},
year={2024},
url={https://huggingface.co/nomic-ai/nomic-embed-text-v1.5}
}Nomic AI (2024). Nomic Embed Text v1.5 [Model card]. Hugging Face. https://huggingface.co/nomic-ai/nomic-embed-text-v1.5
Nomic Embed Text v1.5 (Nomic, Nomic AI, 2024). Available at https://huggingface.co/nomic-ai/nomic-embed-text-v1.5.