NVIDIA · Ada Lovelace
Rent a dedicated NVIDIA L40S for $890 per month
A whole Ada Lovelace GPU with 48 GB of GDDR6 and FP8 Tensor Cores, in a dedicated virtual machine. In stock at one flat monthly price, paid from a balance you top up in crypto.
- GPU memory
- 48 GB GDDR6 ECC
- Bandwidth
- 864 GB/s per GPU
- Interconnect
- PCIe Gen4 x16
- Tensor formats
- FP8 · BF16
- Whole GPU, never shared
- Cancel any month
- 99.9% availability SLA
- Pay with crypto
Configurations & pricing
-
1× L40S In stock
Dedicated VM · full GPU passthrough
16 vCPU · 128 GB RAM · 1 TB NVMe · 10 Gbps
$890/mo
≈ $1.22 per GPU-hour
Delivered in under 10 minutes after payment.
Specifications
L40S specs and server configurations
NVIDIA L40S
- Architecture
- Ada LovelaceNVIDIA
- GPU memory
- 48 GB GDDR6 ECC
- Memory bandwidth
- 864 GB/s
- FP4
- —Not supported
- FP8
- 733 TFLOPS1,466 TFLOPS with sparsity
- BF16 / FP16
- 362 TFLOPS733 TFLOPS with sparsity
- GPU interconnect
- PCIe Gen4 x16no NVLink
- Form factor
Dual-slot PCIe card- Max power
- 350 W
Server configurations
| Specification | 1× L40S |
|---|---|
| GPUs | 1 × 48 GB GDDR6 |
| Server type | Single GPU |
| CPU | 16 vCPU |
| Memory | 128 GB |
| Storage | 1 TB NVMe |
| Network | 10 Gbps |
| Bandwidth | 20 TB/mo included |
| Price | $890/mo |
- Root access over SSH
- Ubuntu with drivers, CUDA and Docker
- IPv4 + IPv6 /64
- DDoS mitigation
Best for
What the L40S is best at
Where this GPU earns its monthly price, and when another one is the smarter choice.
-
Inference of 7B to 14B models
An 8B model in BF16 uses about 16 GB, leaving most of the 48 GB for KV cache.
-
Image generation
SDXL and 12B-parameter image models such as FLUX.1 run in BF16 with room for batches. -
Rendering and media
Ada RT cores and NVENC video encoders for ray-traced rendering and transcoding. -
LoRA and QLoRA
LoRA on 8B models and QLoRA on models up to about 32B fit in 48 GB.
Consider instead
-
NVIDIA RTX PRO 6000 Blackwell
When you need 96 GB per GPU, FP4 or an 8-GPU server, from $1,390 per month. -
NVIDIA H100 SXM
For QLoRA on 70B models, high-concurrency serving or training, where 80 GB of HBM3 at 3.35 TB/s matters. - NVIDIA GeForce RTX 5090 For prototyping and image generation that fit in 32 GB, at $449 per month.
Memory sizing
Which models fit on the L40S?
GPUs needed to serve a model at moderate context: weights plus about 20% for the KV cache and runtime. For your exact model, context and batch size, use the VRAM calculator.
| Model size | BF16 2 bytes/param | FP8 1 byte/param | |
|---|---|---|---|
| 8B Llama 3.1 8B class | 1 GPU | 1 GPU | 1 GPU |
| 14B Qwen3 14B class | 1 GPU | 1 GPU | 1 GPU |
| 32B Qwen3 32B class | Does not fit | 1 GPU | 1 GPU |
| 70B Llama 3.3 70B class | Does not fit | Does not fit | 1 GPU |
| 120B Large dense or MoE | Does not fit | Does not fit | Does not fit |
| 235B Qwen3 235B MoE class | Does not fit | Does not fit | Does not fit |
| 405B Llama 3.1 405B class | Does not fit | Does not fit | Does not fit |
| 671B |
Does not fit | Does not fit | Does not fit |
How to read it
- 1 GPUFits on a single L40S
- tightFits with a short context only
- —Does not fit on this GPU
Sized for real models
Open the VRAM calculatorEstimates for inference with weights quantized to the precision shown; long contexts and large batches need more memory for the KV cache. “Tight” means it fits with a short context only. — means it does not fit on this single GPU.
In short.
What the L40S is, and where it fits in 2026
What fits in 48 GB
- 7B–8B models in BF16: about 16 GB of weights, leaving roughly 25 GB for KV cache after headroom: comfortable for chat, RAG and agent backends.
- 14B models in BF16: about 28 GB, with around 15 GB left for KV cache. In FP8, the same model takes about 14 GB.
- 32B models:
about 32 GB in FP8, which works for short contexts and modest concurrency; in 4-bit , at about 16 GB, there is plenty of room. - 70B models:
FP8, at about 70 GB, does not fit. 4-bit , at about 35 GB, does, but leaves too little KV cache for production use. Move to a 96 GB RTX PRO 6000, or to an H200 for more KV cache, instead. - Image generation:
SDXL, with about 3.5B parameters, runs with large batches, and a 12B-parameter model such as FLUX.1, about 24 GB in BF16, fits together with its text encoders.
Rendering, video and graphics workloads
Software on an L40S server
vllm serve <your-8b-model> --quantization fp8 --max-model-len 32768 \
--host 127.0.0.1 --port 8000
Binding to localhost keeps the endpoint private until you put your own authentication in front of it. Our guide to
L40S price per month and per GPU-hour
One sizing trap to avoid: two L40S plans cost $1,780 per month for 96 GB split across two GPUs, while one RTX PRO 6000 costs $1,390 for 96 GB on a single card. If your model needs more than 48 GB, the larger card is both simpler and less expensive, because nothing has to be split across GPUs.
Ordering an L40S
Deploy it in one form: choose the plan, set up the OS image, optional preinstalled software and your login (root password or SSH key), create a free account or log in, and pay the first month from your prepaid balance, which you top up in BTC, ETH, XMR, USDT on TRON or SOL (card payments are coming soon). The server is delivered in under 10 minutes after payment, with the IP and SSH details in your dashboard. You can cancel any month with no fee, the server running until the end of the paid month. For sizing before you order, use the VRAM calculator.
FAQ
L40S rental FAQ
The short version. The help center has the details, and customers with an active server get answers by ticket, 24/7.
Visit the help centerHow much does it cost to rent an NVIDIA L40S?
Can the L40S run a 70B model?
Does the L40S support FP8?
Yes. Its Ada Lovelace Tensor Cores support FP8, which NVIDIA lists at 733 TFLOPS dense and 1,466 TFLOPS with sparsity.
Can I get an 8-GPU L40S server?
Is the L40S shared or partitioned?
How fast can I get an L40S?
It is in stock at the time of writing, and it is delivered in under 10 minutes after payment.
Deploy a GPU server
Get your L40S server this month.
Choose a configuration, create your account in the same form and pay the first month from your balance. Your server is delivered in under 10 minutes.
- Delivered in under 10 minutes
- Cancel any month
- Pay with crypto, up to +50% bonus