How fast is AMD Ryzen AI 9 HX 370 NPU for local AI workloads?
AMD Ryzen AI 9 HX 370 NPU has a source-attributed result of 8.0 tok/s on Mistral 7B (batch 1, 2048-token context, INT4; runtime not documented). This is a reference report, not an independently verified lab result. A 70B Q4_K_M artifact needs roughly 40GB for weights alone; smaller memory configurations require explicit offload or model splitting and do not establish full-GPU residency.