Llama 4 Maverick is Meta's flagship multimodal MoE — 400 B total parameters across 128 experts with 17 B activated per token. Benchmarks place it near GPT-4o on reasoning and beating Llama 3.1 405B at far lower per-token cost. Realistically it requires a 4x or 8x H100 / B200 cluster (~900 GB at FP16, ~245 GB at Q4_K_M). Not a homelab model.
Llama 4 Maverick 17B needs at minimum 242 GB of VRAM at Q4_K_M quantization (880 GB at FP16). The cheapest GPU that comfortably fits with KV-cache headroom is the Apple Mac Studio (M3 Ultra, 512 GB) (512 GB VRAM, $9,499 MSRP). Community benchmark submissions are open. This model exceeds 48 GB at Q4, so plan for a 2-or-more-GPU split.
Weights only. Add ~20-30% for KV cache at typical context lengths.
| Quant | VRAM | Quality | Notes |
|---|---|---|---|
| FP16 | 880.0 GB | Reference | Training-precision weights |
| Q8_0 | 440.0 GB | Near-lossless | 8-bit, ~0.1% perplexity hit |
| Q6_K | 356.4 GB | Very high | 6-bit, near Q8 quality |
| Q5_K_M | 303.6 GB | High | Strong middle ground |
| Q4_K_M | 242.0 GB | Balanced (recommended) | Default for local deployments |
| Q4_0 | 247.5 GB | Legacy 4-bit | Older GGUF, kept for compatibility |
| Q3_K_M | 189.2 GB | Lossy | When VRAM is very tight |
| Q2_K | 140.8 GB | Extreme | Rescue option, quality degrades visibly |
Filtered from MyAIHardware's GPU database. FP16 needs 880.0 GB; Q4_K_M needs 242.0 GB.
| GPU | Per-card VRAM | 2x | 4x | 8x |
|---|---|---|---|---|
| AMD Instinct MI300X | 192 GB | 384 | 768 | 1536 |
| Apple Mac Studio (M2 Ultra, 192 GB) | 192 GB | 384 | 768 | 1536 |
| Apple Mac Pro (M2 Ultra, 192 GB) | 192 GB | 384 | 768 | 1536 |
| NVIDIA B200 | 180 GB | 360 | 720 | 1440 |
| NVIDIA B100 | 180 GB | 360 | 720 | 1440 |
| NVIDIA H200 | 141 GB | 282 | 564 | 1128 |
We don't have community benchmarks for this exact model yet.
Official weights + popular runtime tags.
ollama pull llama4:maverickStep-by-step guides that use this model.
Models in a similar size or capability class.
Use these in papers, blog posts, or internal docs.
@misc{llama-4-maverick-2025,
title={Llama 4 Maverick 17B},
author={Meta AI},
year={2025},
url={https://huggingface.co/meta-llama/Llama-4-Maverick-17B-128E-Instruct}
}Meta AI (2025). Llama 4 Maverick 17B [Model card]. Hugging Face. https://huggingface.co/meta-llama/Llama-4-Maverick-17B-128E-Instruct
Llama 4 Maverick 17B (Llama 4, Meta AI, 2025). Available at https://huggingface.co/meta-llama/Llama-4-Maverick-17B-128E-Instruct.