Hardware
Supported GPUs
LocalMax computes the tier from the total VRAM in a system, not from one card. Two RTX PRO 6000 cards reach Prospector, and so does a DGX Spark.
Fills Entry alone
12 GB to 17 GB. One card fills the Entry tier.| GPU | VRAM | Bandwidth | TDP | Architecture | Lanes | Tiers | Results |
|---|---|---|---|---|---|---|---|
| GeForce RTX 3060 12GB | 12 GB | 360 GB/s | 170 W | ampere | INT4 | Entry | — |
| GeForce RTX 4060 Ti 16GB | 16 GB | 288 GB/s | 165 W | ada | FP8 · INT4 | Entry | — |
| GeForce RTX 4070 | 12 GB | 504 GB/s | 200 W | ada | FP8 · INT4 | Entry | — |
| GeForce RTX 4080 SUPER | 16 GB | 736 GB/s | 320 W | ada | FP8 · INT4 | Entry | — |
| GeForce RTX 5070 | 12 GB | 672 GB/s | 250 W | blackwell | FP8 · INT4 · NVFP4 | Entry | — |
| GeForce RTX 5070 Ti | 16 GB | 896 GB/s | 300 W | blackwell | FP8 · INT4 · NVFP4 | Entry | — |
| GeForce RTX 5080 | 16 GB | 960 GB/s | 360 W | blackwell | FP8 · INT4 · NVFP4 | Entry | — |
Fills Enthusiast alone
24 GB to 48 GB. One card fills Entry and Enthusiast.| GPU | VRAM | Bandwidth | TDP | Architecture | Lanes | Tiers | Results |
|---|---|---|---|---|---|---|---|
| GeForce RTX 3090 | 24 GB | 936 GB/s | 350 W | ampere | INT4 | Entry, Enthusiast | — |
| GeForce RTX 3090 Ti | 24 GB | 1,008 GB/s | 450 W | ampere | INT4 | Entry, Enthusiast | — |
| GeForce RTX 4090 | 24 GB | 1,008 GB/s | 450 W | ada | FP8 · INT4 | Entry, Enthusiast | — |
| GeForce RTX 5090 | 32 GB | 1,792 GB/s | 575 W | blackwell | FP8 · INT4 · NVFP4 | Entry, Enthusiast | — |
| RTX A6000 | 48 GB | 768 GB/s | 300 W | ampere | INT4 | Entry, Enthusiast | — |
| RTX 6000 Ada | 48 GB | 960 GB/s | 300 W | ada | FP8 · INT4 | Entry, Enthusiast | — |
| L40S | 48 GB | 864 GB/s | 350 W | ada | FP8 · INT4 | Entry, Enthusiast | — |
Fills Prospector alone
64 GB and more. One card fills every tier.| GPU | VRAM | Bandwidth | TDP | Architecture | Lanes | Tiers | Results |
|---|---|---|---|---|---|---|---|
| RTX PRO 6000 Blackwell | 96 GB | 1,792 GB/s | 600 W | blackwell | FP8 · INT4 · NVFP4 | Entry, Enthusiast, Prospector | — |
| DGX Spark (GB10) | 128 GB | 273 GB/s | 140 W | blackwell-gb10 · unified | FP8 · INT4 · NVFP4 | Entry, Enthusiast, Prospector | — |
A note on DGX Spark
GB10 is an aarch64 system. Its 128 GB of LPDDR5X is shared between the CPU and the GPU. It has large capacity and moderate bandwidth. It holds models that no other system here can hold. It is slower than a discrete card on decode.
Its power is measured at the SoC module, not at a GPU board. These are different quantities. LocalMax shows the wattage with a label, but it does not rank a Spark for energy against a discrete card.