Documentation
GPU server documentation
Get started
4 guides- GPU server quickstartLog in over SSH, check the GPUs, update Ubuntu and run a first GPU container, with a check at each step.
- SSH into a GPU server
Create an ed25519 key on macOS, Linux or Windows, connect, add teammates and disable password login. Copy-ready steps. - VS Code Remote SSH and Jupyter on a GPU serverUse VS Code Remote SSH on your GPU server, run Jupyter on a remote GPU through an SSH tunnel and move data with rsync and scp. Safe defaults, step by step.
- Ubuntu GPU image with CUDA preinstalledWhat our Ubuntu GPU image with CUDA preinstalled contains, how to check driver and toolkit versions, pick 22.04 or 24.04 and keep the driver pinned safely.
GPU software
6 guides- Check CUDA version and NVIDIA driver on Ubuntu
Check NVIDIA driver and CUDA version with nvidia-smi and nvcc, see how they must match and add a CUDA toolkit on Ubuntu 24.04 without a new driver. - ROCm setup for AMD Instinct MI355X
Check GPUs with rocm-smi andamd-smi , set user groups, run PyTorch and vLLM in ROCm containers and test RCCL. - Docker GPU containers with the NVIDIA Container ToolkitUse --gpus, select devices, reserve GPUs in Compose, fix PyTorch shared memory and run ROCm containers.
- Serve an LLM with vLLM
Set up Python with uv, install PyTorch and vLLM, test the OpenAI-compatible API and run it as a service. NCCL tests on a multi-GPU server: all_reduce_perf step by stepCheck NVLink topology, build nccl-tests , read busbw from all_reduce_perf and launch torchrun jobs across 8 GPUs.nvidia-smi commands for monitoring GPU serversLive views, CSV logs, nvtop, DCGM exporter, ECC and Xid errors, plus rocm-smi equivalents.
Server setup
2 guidesStill need help?
- Support by ticketCustomers with an active server open tickets from their dashboard; engineers answer 24/7.How support works
- Help centerBilling, delivery, refunds, verification and policies, in plain words.Open
- System statusCurrent status of ordering, provisioning, servers, network and support.Check status