RTX PRO 6000 Blackwell Workstation Edition
96 GB GDDR7 ECC · 1.79 TB/s
- Power
- 600 W
- Fits
- RackTowerDesktop
- Precision
- FP4 · FP8 · FP16
- Model tags
- 122B MoE2× → 122B MoE
- Typical TPS
- ≈ 230 tok/sgpt-oss-120b · FP4 · one user
- Users
- ≈ 110–180at ≥15 tok/s each
- Runs
- Qwen3.5 122B-A10Bgpt-oss-120bMistral Small 4Jais 2 70BALLaM 7B
Interconnect: PCIe 5.0 x16Cooling: Active — flow-through
2× grouped · 2 cards · PCIe · Qwen3.5 122B-A10B · ≈ 110 tok/s · ≈ 370–620
Sources: 1
RTX PRO 6000 Blackwell Max-Q Workstation Edition
96 GB GDDR7 ECC · 1.79 TB/s
- Power
- 300 W
- Fits
- RackTowerDesktop
- Precision
- FP4 · FP8 · FP16
- Model tags
- 122B MoE4× → 397B MoE
- Typical TPS
- ≈ 230 tok/sgpt-oss-120b · FP4 · one user
- Users
- ≈ 110–180at ≥15 tok/s each
- Runs
- Qwen3.5 122B-A10Bgpt-oss-120bMistral Small 4Jais 2 70BALLaM 7B
Interconnect: PCIe 5.0 x16Cooling: Active — blower
4× grouped · 4 cards in one tower · PCIe · Qwen3.5 397B-A17B · ≈ 110 tok/s · ≈ 72–120
The same chip and 96 GB as the Workstation Edition at half the power — built to stack four in one tower.
Sources: 1
RTX PRO 5000 Blackwell 72GB
72 GB GDDR7 ECC · 1.34 TB/s
- Power
- 300 W
- Fits
- RackTowerDesktop
- Precision
- FP4 · FP8 · FP16
- Model tags
- ≤ 70B4× → 355B MoE
- Typical TPS
- ≈ 23 tok/sJais 2 70B · FP4 · one user
- Users
- ≈ 14–24at ≥15 tok/s each
- Runs
- Jais 2 70BQwen3.6 35B-A3BGemma 4 31Bgpt-oss-20bALLaM 7B
Interconnect: PCIe 5.0 x16Cooling: Active — blower
4× grouped · 4 cards in one tower · PCIe · GLM-4.7 · ≈ 73 tok/s · ≈ 15–25
Sources: 1 · 2
RTX PRO 5000 Blackwell 48GB
48 GB GDDR7 ECC · 1.34 TB/s
- Power
- 300 W
- Fits
- RackTowerDesktop
- Precision
- FP4 · FP8 · FP16
- Model tags
- ≤ 70B4× → 122B MoE
- Typical TPS
- ≈ 260 tok/sQwen3.6 35B-A3B · FP4 · one user
- Users
- ≈ 220–360at ≥15 tok/s each
- Runs
- Qwen3.6 35B-A3BGemma 4 31Bgpt-oss-20bALLaM 7B
Interconnect: PCIe 5.0 x16Cooling: Active — blower
4× grouped · 4 cards in one tower · PCIe · Qwen3.5 122B-A10B · ≈ 120 tok/s · ≈ 640–1,100
Sources: 1
RTX PRO 4500 Blackwell Workstation Edition
32 GB GDDR7 ECC · 0.90 TB/s
- Power
- 200 W
- Fits
- RackTowerDesktop
- Precision
- FP4 · FP8 · FP16
- Model tags
- 35B MoE4× → 122B MoE
- Typical TPS
- ≈ 210 tok/sQwen3.6 35B-A3B · FP4 · one user
- Users
- ≈ 84–140at ≥15 tok/s each
- Runs
- Qwen3.6 35B-A3BGemma 4 31Bgpt-oss-20bALLaM 7B
Interconnect: PCIe 5.0 x16Cooling: Active — blower
4× grouped · 4 cards in one tower · PCIe · Qwen3.5 122B-A10B · ≈ 110 tok/s · ≈ 290–480
Sources: 1
RTX PRO 4000 Blackwell
24 GB GDDR7 ECC · 0.67 TB/s
- Power
- 145 W
- Fits
- RackTowerDesktop
- Precision
- FP4 · FP8 · FP16
- Model tags
- 35B MoE4× → 122B MoE
- Typical TPS
- ≈ 30 tok/sQwen3.8 27B · FP4 · one user
- Users
- ≈ 37–61at ≥15 tok/s each
- Runs
- Gemma 4 31BQwen3.8 27Bgpt-oss-20bALLaM 7B
Interconnect: PCIe 5.0 x16Cooling: Active fan
4× grouped · 4 single-slot cards · PCIe · Qwen3.5 122B-A10B · ≈ 91 tok/s · ≈ 61–100
Single-slot.
Sources: 1
RTX PRO 4000 Blackwell SFF Edition
24 GB GDDR7 ECC · 0.43 TB/s
- Power
- 70 W
- Fits
- RackTowerDesktop
- Precision
- FP4 · FP8 · FP16
- Model tags
- 35B MoE
- Typical TPS
- ≈ 20 tok/sQwen3.8 27B · FP4 · one user
- Users
- ≈ 37–61at ≥15 tok/s each
- Runs
- Gemma 4 31BQwen3.8 27Bgpt-oss-20bALLaM 7B
Interconnect: PCIe 5.0 x8Cooling: Active fan
Low-profile, 70 W, powered from the slot.
Sources: 1
RTX PRO 2000 Blackwell
16 GB GDDR7 ECC · 0.29 TB/s
- Power
- 70 W
- Fits
- RackTowerDesktop
- Precision
- FP4 · FP8 · FP16
- Model tags
- 25B MoE
- Typical TPS
- ≈ 38 tok/sQwen3.5 9B · FP4 · one user
- Users
- ≈ 110–180at ≥15 tok/s each
- Runs
- Qwen3.5 9BALLaM 7B
Interconnect: PCIe 5.0 x8Cooling: Active fan
Low-profile, 70 W, powered from the slot.
Sources: 1
RTX 6000 Ada Generation
48 GB GDDR6 ECC · 0.96 TB/s
- Power
- 300 W
- Fits
- RackTowerDesktop
- Precision
- FP8 · FP16
- Model tags
- ≤ 70B4× → 122B MoE
- Typical TPS
- ≈ 220 tok/sQwen3.6 35B-A3B · 4-bit · one user
- Users
- ≈ 220–360at ≥15 tok/s each
- Runs
- Qwen3.6 35B-A3BGemma 4 31Bgpt-oss-20bALLaM 7B
Interconnect: PCIe 4.0 x16Cooling: Active — blower
4× grouped · 4 cards in one tower · PCIe · Qwen3.5 122B-A10B · ≈ 110 tok/s · ≈ 460–770
Sources: 1
RTX 5880 Ada Generation
48 GB GDDR6 ECC · 0.96 TB/s
- Power
- 285 W
- Fits
- RackTowerDesktop
- Precision
- FP8 · FP16
- Model tags
- ≤ 70B4× → 122B MoE
- Typical TPS
- ≈ 220 tok/sQwen3.6 35B-A3B · 4-bit · one user
- Users
- ≈ 220–360at ≥15 tok/s each
- Runs
- Qwen3.6 35B-A3BGemma 4 31Bgpt-oss-20bALLaM 7B
Interconnect: PCIe 4.0 x16Cooling: Active — blower
4× grouped · 4 cards in one tower · PCIe · Qwen3.5 122B-A10B · ≈ 110 tok/s · ≈ 460–770
Sources: 1
RTX 5000 Ada Generation
32 GB GDDR6 ECC · 0.58 TB/s
- Power
- 250 W
- Fits
- RackTowerDesktop
- Precision
- FP8 · FP16
- Model tags
- 35B MoE4× → 122B MoE
- Typical TPS
- ≈ 160 tok/sQwen3.6 35B-A3B · 4-bit · one user
- Users
- ≈ 84–140at ≥15 tok/s each
- Runs
- Qwen3.6 35B-A3BGemma 4 31Bgpt-oss-20bALLaM 7B
Interconnect: PCIe 4.0 x16Cooling: Active — blower
4× grouped · 4 cards in one tower · PCIe · Qwen3.5 122B-A10B · ≈ 88 tok/s · ≈ 47–79
Sources: 1
RTX 4500 Ada Generation
24 GB GDDR6 ECC · 0.43 TB/s
- Power
- 210 W
- Fits
- RackTowerDesktop
- Precision
- FP8 · FP16
- Model tags
- 35B MoE4× → 122B MoE
- Typical TPS
- ≈ 20 tok/sQwen3.8 27B · 4-bit · one user
- Users
- ≈ 37–61at ≥15 tok/s each
- Runs
- Gemma 4 31BQwen3.8 27Bgpt-oss-20bALLaM 7B
Interconnect: PCIe 4.0 x16Cooling: Active — blower
4× grouped · 4 cards in one tower · PCIe · Qwen3.5 122B-A10B · ≈ 76 tok/s · ≈ 25–41
Sources: 1 · 2
RTX 4000 Ada Generation
20 GB GDDR6 ECC · 0.36 TB/s
- Power
- 130 W
- Fits
- RackTowerDesktop
- Precision
- FP8 · FP16
- Model tags
- ≤ 31B4× → ≤ 70B
- Typical TPS
- ≈ 98 tok/sgpt-oss-20b · 4-bit · one user
- Users
- ≈ 40–68at ≥15 tok/s each
- Runs
- Gemma 4 26B-A4Bgpt-oss-20bQwen3.5 9BALLaM 7B
Interconnect: PCIe 4.0 x16Cooling: Active fan
4× grouped · 4 single-slot cards · PCIe · Jais 2 70B · ≈ 14 tok/s · ≈ 1
Single-slot.
Sources: 1
RTX 4000 SFF Ada Generation
20 GB GDDR6 ECC · 0.28 TB/s
- Power
- 70 W
- Fits
- RackTowerDesktop
- Precision
- FP8 · FP16
- Model tags
- ≤ 31B
- Typical TPS
- ≈ 80 tok/sgpt-oss-20b · 4-bit · one user
- Users
- ≈ 17–29at ≥15 tok/s each
- Runs
- Gemma 4 26B-A4Bgpt-oss-20bQwen3.5 9BALLaM 7B
Interconnect: PCIe 4.0 x16Cooling: Active fan
Low-profile, 70 W, powered from the slot.
Sources: 1
RTX 2000 Ada Generation
16 GB GDDR6 ECC · 0.22 TB/s
- Power
- 70 W
- Fits
- RackTowerDesktop
- Precision
- FP8 · FP16
- Model tags
- 25B MoE
- Typical TPS
- ≈ 30 tok/sQwen3.5 9B · 4-bit · one user
- Users
- ≈ 46–76at ≥15 tok/s each
- Runs
- Qwen3.5 9BALLaM 7B
Interconnect: PCIe 4.0 x8Cooling: Active fan
Low-profile, 70 W, powered from the slot.
Sources: 1
A800 40GB Active
40 GB HBM2 · 1.55 TB/s
- Power
- 240 W
- Fits
- RackTowerDesktop
- Precision
- INT8 · FP16
- Model tags
- 35B MoE4× → 122B MoE
- Typical TPS
- ≈ 280 tok/sQwen3.6 35B-A3B · 4-bit · one user
- Users
- ≈ 150–250at ≥15 tok/s each
- Runs
- Qwen3.6 35B-A3BGemma 4 31Bgpt-oss-20bALLaM 7B
Interconnect: NVLink bridge (pair) · 400 GB/sCooling: Active — blower
4× grouped · 4 cards in one tower · PCIe · Qwen3.5 122B-A10B · ≈ 120 tok/s · ≈ 460–770
NVIDIA’s name is “A800 40GB Active” (some resellers write RTX A800). A compute card with no display outputs.
Sources: 1 · 2