How fast is NVIDIA GeForce RTX 5060 Ti 8GB for local AI workloads?
NVIDIA GeForce RTX 5060 Ti 8GB hits 158.0 tok/s on Phi-3 Mini, its strongest benchmarked workload (batch 1, 4096-token context, 8GB VRAM, 180W TDP). It has 3 records across 2 workloads in our database, with a MyAI Rating of 8.6/10. Llama 3 70B Q4 needs ~40GB VRAM, so check the VRAM column before assuming feasibility.