microsoft/Phi-3-medium-4k-instruct
14B params · est. 8.4 GB Q4
AMD Instinct MI300X 192GB: likely fitNVIDIA H200 141GB: likely fit
Head-to-head
AMD Instinct MI300X 192GB vs NVIDIA H200 141GB
Compare recorded specifications and inspect source links for both devices. Speed comparisons appear only when workload, runtime version, quantization, context and batch match.
Device profile
AMD Instinct MI300X 192GB
70B FP16 or smaller quantized artifacts with measured context headroom. Standard 405B Q4 exceeds 192GB before runtime overhead.
Curated Aggregate·2026-03-19192GB / $15k
Speed evidence
Matched rows below
VRAM
192 GB
TDP
750 W
Rating
Not scored
Device profile
NVIDIA H200 141GB
Large quantized models that fit after runtime and context allocations; 405B FP8 does not fit a single 141GB device.
Curated Aggregate·2026-04-20141GB / $35k
Speed evidence
Matched rows below
VRAM
141 GB
TDP
700 W
Rating
Not scored
Quick verdict
Speed comparisons require matching runtime settings. A missing score means insufficient comparative evidence.
AMD Instinct MI300X 192GB wins VRAM capacity.
NVIDIA H200 141GB has the lower published power rating.
| Metric | AMD Instinct MI300X 192GB | NVIDIA H200 141GB |
|---|---|---|
| MyAI rating | Not scored | Not scored |
| Speed comparison | See matched rows below | See matched rows below |
| VRAM | 192 GB | 141 GB |
| TDP | 750 W | 700 W |
| MSRP | $15k | $35k |
| Workloads | 12 | 11 |
Shared benchmark rows
No batch-one rows with matching model, quantization, context, runtime and offload notes are available. We cannot calculate a comparable speed difference.
External quality layer
Best open models likely to fit this class
This shortlist cross-references the external OpenEvals snapshot with an approximate Q4-class VRAM estimate. Use it to sanity-check whether the hardware you are comparing can host strong open models, not just benchmark toy workloads.
91.0
Qwen/Qwen2-72B
73B params · est. 43.6 GB Q4
AMD Instinct MI300X 192GB: likely fitNVIDIA H200 141GB: likely fit
microsoft/Phi-3.5-mini-instruct
3.8B params · est. 2.3 GB Q4
AMD Instinct MI300X 192GB: likely fitNVIDIA H200 141GB: likely fit
internlm/internlm2_5-7b-chat
7.7B params · est. 4.6 GB Q4
AMD Instinct MI300X 192GB: likely fitNVIDIA H200 141GB: likely fit