VRAM
24 GB
TDP
22 W
MSRP
$1.6k
Perf/W
0.82 tok/s/W
Cost/1K tok
$0.94/M
Tested
2024-12-21
Apple M4 (10c GPU, 24GB) has a source-attributed result of 18.0 tok/s on Llama 3 8B Q4 (batch 1, 4096-token context, Q4_K_M; runtime not documented). This is a reference report, not an independently verified lab result. A 70B Q4_K_M artifact needs roughly 40GB for weights alone; smaller memory configurations require explicit offload or model splitting and do not establish full-GPU residency.
Apple M4 (10c GPU, 24GB) with 24GB VRAM at 22W TDP, scored across 3 workloads with 3 benchmark records.
Reference workload
Llama 3 8B Q4
18 tok/s
Quantization
Q4_K_M
4K context · batch 1
| Workload | Score | Quant | Context | σ | Status | Tested |
|---|---|---|---|---|---|---|
| Llama 3 8B Q4 llm | 18.0tok/s | Q4_K_M | 4K | , | Curated Aggregate | 2024-12-21 |
| Mistral 7B llm | 22.0tok/s | Q4_K_M | 4K | , | Curated Aggregate | 2024-11-22 |
| Phi-3 Mini llm | 48.0tok/s | Q4_K_M | 4K | , | Curated Aggregate | 2024-12-15 |
There is insufficient comparable evidence to score Apple M4 (10c GPU, 24GB). A score needs results for multiple devices with matching workload, runtime version, quantization, context and batch size.
Planning estimates for 24GB: weights plus at least 2GB or 10% overhead. Actual KV cache depends on model, context and cache format; confirm the artifact before buying.
Trust score
6/10
MyAI rating
Not scored
Runs
Not documented
Freshness
Stale
Source-linked row with explicit verification status.
Record date: 2024-12-21; 627 days old.
Best place to start
Retailer we'd check first
Amazon search
Amazon is a fast way to check live availability, but memory tier and exact SKU matter more than the first visible price.
Search Amazon listingsThere is insufficient comparable evidence for a purchase recommendation. Check model fit, software support and a current seller quote.
Affiliate note: we do not have a device-level ASIN yet, so this opens tagged Amazon search results for the exact product name.