EdgeNVIDIA

NVIDIA Jetson AGX Orin 64GB

Curated Aggregate·2025-08-123 workloads · 3 records
MyAI RatingNot scoredInsufficient comparison evidence

VRAM

64 GB

TDP

60 W

MSRP

$2.0k

Perf/W

0.27 img/min/W

Cost/1K tok

$0.0013/k

Tested

2025-08-12

Quick answer

How fast is NVIDIA Jetson AGX Orin 64GB for local AI workloads?

NVIDIA Jetson AGX Orin 64GB has a source-attributed result of 1.8 img/min on SDXL image gen (batch 1, 0-token context, FP16; runtime not documented). This is a reference report, not an independently verified lab result. A 70B Q4_K_M artifact needs roughly 40GB for weights alone; smaller memory configurations require explicit offload or model splitting and do not establish full-GPU residency.

Source: MyAIHardware benchmark database (bench-orin-agx-64gb-sdxl)As of 2025-09-18

Verdict

NVIDIA Jetson AGX Orin 64GB with 64GB VRAM at 60W TDP, scored across 3 workloads with 3 benchmark records.

Reference workload

SDXL image gen

1.8 img/min

Quantization

FP16

· batch 1

LLM Inference Performance

06121824Qwen 2.514BDeepSeek-R17B

Benchmarks (3 workloads)

WorkloadScoreQuantContextσStatusTested
Qwen 2.5 14B

llm

16.0tok/sQ4_K_M4K, Curated Aggregate2025-08-12
DeepSeek-R1 7B

llm

22.0tok/sQ4_K_M8K, Curated Aggregate2025-09-04
SDXL image gen

image

1.8img/minFP16, , Curated Aggregate2025-09-18

MyAI Score: not scored

There is insufficient comparable evidence to score NVIDIA Jetson AGX Orin 64GB. A score needs results for multiple devices with matching workload, runtime version, quantization, context and batch size.

Workload Fit

Planning estimates for 64GB: weights plus at least 2GB or 10% overhead. Actual KV cache depends on model, context and cache format; confirm the artifact before buying.

Q4
Q8
FP16
7-8B
Excellent
Excellent
Excellent
13-14B
Excellent
Excellent
Excellent
32B
Excellent
Excellent
Won't fit
70B
Excellent
Won't fit
Won't fit
Reported batch-one examples
SDXL image gen2 img/min
DeepSeek-R1 7B22 tok/s
Qwen 2.5 14B16 tok/s

Source

Stable Diffusion on edge.

View sourceHow we benchmark →

Public Trust Layer

Trust score

6/10

MyAI rating

Not scored

Runs

Not documented

Freshness

Stale

Source-linked row with explicit verification status.

Record date: 2025-09-18; 356 days old.

Open primary source

Best place to start

Where to buy

Search first

Retailer we'd check first

Amazon search

For mainstream AI hardware, Amazon usually updates street pricing, seller availability, and shipping speed faster than most comparison sites.

Search Amazon listings
  • +Use $2.0k as your price anchor unless the part is clearly supply-constrained or newly launched.
  • +Check the exact cooler, board partner, or memory configuration before buying. The silicon may match, but noise and thermals do not.
  • +If the Amazon price looks inflated, wait or compare against recent street pricing rather than paying a panic premium.

There is insufficient comparable evidence for a purchase recommendation. Check model fit, software support and a current seller quote.

Affiliate note: we do not have a device-level ASIN yet, so this opens tagged Amazon search results for the exact product name.

Same Tier

NVIDIA Jetson AGX Orin 64GB
64GB
NVIDIA Jetson Orin Nano 8GB
8GB
Raspberry Pi 5 + AI HAT+ (Hailo-8)
8GB
NVIDIA Jetson Orin Nano Super 8GB
8GB
NVIDIA Jetson Orin NX 16GB
16GB
Raspberry Pi 5 8GB
0GB