NVIDIA · Rubin
Rent NVIDIA Vera Rubin NVL72: reserve rack-scale capacity
- GPU memory
- 288 GB HBM4
- Bandwidth
- 19.2 TB/s per GPU
- Interconnect
- NVLink 6
- Tensor formats
- NVFP4 · FP8 · BF16
- Whole GPUs, never shared
- Price and term confirmed in writing
- Pay with crypto
- Engineers 24/7
Configurations & pricing
-
Vera Rubin NVL72 Reservations open
Rack-scale · one NVLink domain36× NVIDIA Vera · Up to 54 TB LPDDR5X · Storage sized per order · NVLink 6 · ConnectX-9 Price on request
Allocation confirmed in writing
Delivered in under 10 minutes after payment.
Specifications
Vera Rubin NVL72 specs and server configurations
NVIDIA Vera Rubin NVL72 · per GPU
- Architecture
- RubinNVIDIA
- GPU memory
- 288 GB HBM4Preliminary figures published by NVIDIA, subject to change.
- Memory bandwidth
- 19.2 TB/s
- FP4
- 35,000 TFLOPSNVFP4 · 50,000 TFLOPS with sparsity
- FP8
- 17,500 TFLOPSDense
- BF16 / FP16
- 4,000 TFLOPSDense
- GPU interconnect
- NVLink 6
72-GPU domain - Form factor
Vera Rubin rack · liquid-cooled - Max power
Rack-level
Server configurations
| Specification | Vera Rubin NVL72 |
|---|---|
| GPUs | 72 × 288 GB HBM4 |
| Server type | |
| CPU | 36× NVIDIA Vera |
| Memory | Up to 54 TB LPDDR5X |
| Storage | Storage sized per order |
| Network | |
| Bandwidth | Agreed per contract |
| Price | Price on request |
- Root access over SSH
- Ubuntu with drivers, CUDA and Docker
- IPv4 + IPv6 /64
- DDoS mitigation
Best for
What the Vera Rubin NVL72 is best at
Where this GPU earns its monthly price, and when another one is the smarter choice.
-
Securing future capacity
Register interest early for an allocation while rack-scale GPU capacity stays tight. -
288 GB of HBM4 per GPU
About 20.7 TB of HBM4 across 72 GPUs for frontier-scale training and inference. -
One NVLink 6 domain
72 Rubin GPUs and 36 Vera CPUs connected in a single rack-scale NVLink 6 system. -
Next-generation training plansTeams planning their next large training runs on NVIDIA's Rubin generation.
Memory sizing
Which models fit on the Vera Rubin NVL72?
GPUs needed to serve a model at moderate context: weights plus about 20% for the KV cache and runtime, split across GPUs with tensor parallelism. For your exact model, context and batch size, use the VRAM calculator.
| Model size | BF16 2 bytes/param | FP8 1 byte/param | |
|---|---|---|---|
| 8B Llama 3.1 8B class | 1 GPU | 1 GPU | 1 GPU |
| 14B Qwen3 14B class | 1 GPU | 1 GPU | 1 GPU |
| 32B Qwen3 32B class | 1 GPU | 1 GPU | 1 GPU |
| 70B Llama 3.3 70B class | 1 GPU | 1 GPU | 1 GPU |
| 120B Large dense or MoE | 1 GPU | 1 GPU | 1 GPU |
| 235B Qwen3 235B MoE class | 2 GPUs | 1 GPU | 1 GPU |
| 405B Llama 3.1 405B class | 4 GPUs | 2 GPUs | 1 GPU |
| 671B |
8 GPUs | 4 GPUs | 2 GPUs |
How to read it
- 1 GPUFits on a single Rubin GPU
- 2 GPUsSplit with tensor parallelism inside one rack
- tightFits with a short context only
- —Does not fit in one rack
Sized for real models
Open the VRAM calculatorIn short. OverGPU takes reservations for the NVIDIA Vera Rubin NVL72: one rack of 72 GPUs with 288 GB of HBM4 each, price on request. Reservations are made online, and nothing is charged until OverGPU confirms the price and the term. Prices as of .
What we can say about Vera Rubin NVL72 today
- GPUs 72 Rubin GPUs per rack, with 288 GB of HBM4 each, about 20.7 TB in total
- CPUs 36 Vera CPUs
- Interconnect NVLink 6, the generation after the NVLink 5 used in Blackwell systems
- Form
Liquid-cooled ,rack-scale system - Availability Limited, expected in late 2026
That list is deliberately short. The compute and bandwidth figures in the specifications above are preliminary numbers published by NVIDIA and may change before systems ship; we confirm the exact configuration of the systems we rent in writing. What you can plan with today is memory: 288 GB per GPU, the same capacity as the B300, now in HBM4, a newer memory generation than the HBM3e of Blackwell systems.
How a Vera Rubin NVL72 reservation works
- Register interest. Create a free account and send a reservation request from the deployment page, with these details in the notes: what you plan to run, how many GPUs or racks you need, the term you have in mind, and your earliest and latest acceptable start dates.
- We confirm in writing. When we can allocate capacity, we send the allocation, price and term in writing. Nothing is due before this confirmation.
- You decide. If the terms work for you, you accept them; if not, you walk away without having paid anything.
- Payment. You pay from your account balance, which you top up in crypto.
For an order of this size, we may ask for verification of your company and intended use before confirming, as described in our verification policy. Sharing how flexible your dates are helps us match you with the capacity we can allocate.
Should you reserve Vera Rubin or rent what ships now?
A reservation makes sense when your plans already point past what is available today:
You have a training roadmap that runs into 2027 and calls for a 72-GPU NVLink domain on the newest generation.Your models, or their training state, already outgrow an 8-GPU server, so you will needrack-scale capacity in any case.- You want an allocation and a price in writing before you commit budget.
It makes less sense if you need GPUs this quarter, if your jobs fit in eight GPUs, or if you are still deciding what to train; monthly servers keep your options open in those cases. If you do reserve, a useful request states the model size and precision you plan to run, the number of GPUs, the term, your start window and any constraints on location, so that our written answer can be specific.
Planning a Vera Rubin workload now
Inference of a about 1 TB of weights, so at least four GPUs for the weights alone; a full rack leaves roughly 19 TB for KV cache, activations and other models.one-trillion-parameter model in FP8:Full training of a 405B-class model:about 6.5–8.1 TB of training state, or 23 to 29 GPUs' worth of memory before activations, well within one72-GPU rack.Full training of a one-trillion-parameter model:about 16–20 TB, close to the rack's entire 20.7 TB of HBM4, so plan for activation memory on top, either across racks or with offloading.
Our VRAM calculator runs these numbers for other sizes. On the software side, a new GPU architecture usually means new driver, CUDA and framework versions, so keep your stack containerized and pinned, and plan time to validate it on the new systems before you move production work.
Need capacity before Vera Rubin ships?
Two options are available today, with up to 288 GB of memory per GPU:
- HGX B300 servers
: eight Blackwell Ultra GPUs per server at $39,900 per month, with a cancel with no fee. Stock is limited.one-month minimum term. Because plans run month to month, you can keep them until your Vera Rubin capacity is delivered and then - GB300 NVL72
: 72 Blackwell Ultra GPUs in one NVLink domain, from $7,990 per GPU per month on 12 to 36 month terms. Choose it if you need a rack-scale NVLink domain now, and set the term length with your Vera Rubin timeline in mind, since the two commitments would otherwise overlap.
One practical approach is to start training on HGX B300 servers, keep checkpoints and data pipelines portable, and move the next run to Vera Rubin once it is delivered. HGX B300 servers are ordered directly on the deployment page and delivered in under 10 minutes after payment; your Vera Rubin reservation request is sent from the same page.
Vera Rubin NVL72 pricing
Vera Rubin NVL72, price on request
Reservations open · delivered in under 10 minutes.
Compare all 15 configurationsFAQ
Vera Rubin NVL72 rental FAQ
The short version. The help center has the details, and customers with an active server get answers by ticket, 24/7.
Visit the help centerHow do I make a Vera Rubin NVL72 reservation?
Create a free account and send a reservation request from the deployment page, with your workload, GPU count, term and preferred start dates in the notes. We then confirm allocation and terms in writing before any payment.
Do I pay anything to reserve?
No payment is taken when you register interest. You pay from your account balance only after accepting the written confirmation of allocation, price and terms.
When will Vera Rubin NVL72 be available?
Limited availability is expected in late 2026.
How much does it cost to rent Vera Rubin NVL72?
There is no list price yet. Each reservation is confirmed in writing with its configuration, price and term before you pay.
Are the Vera Rubin figures final?
No. The compute and bandwidth figures on this page are preliminary numbers published by NVIDIA and may change before systems ship. Plan with the memory capacity, 288 GB of HBM4 per GPU; we confirm the exact configuration in writing before you pay.
What can I use until Vera Rubin arrives?
Deploy a GPU server
Plan your Vera Rubin NVL72 capacity.
Send a reservation request with the GPU count, term and timing in the notes. We confirm the allocation, price and term in your dashboard before any payment.
- Allocation and terms in writing
- No payment before confirmation
- Pay with crypto, up to +50% bonus