How fast is Intel Core Ultra 9 285K NPU for local AI workloads?
Intel Core Ultra 9 285K NPU has a source-attributed result of 24.0 tok/s on Phi-3 Mini (batch 1, 4096-token context, Q4_K_M; runtime not documented). This is a reference report, not an independently verified lab result. A 70B Q4_K_M artifact needs roughly 40GB for weights alone; smaller memory configurations require explicit offload or model splitting and do not establish full-GPU residency.