Machine learning server requirements
Machine learning server requirements for training and inference: compare CPU, GPU, RAM, storage, provider fit, and operational risks.
7 min read
L
- Founded
- 2012
- plans
- 22
- Public API
- yes
Plans mini-screener
All sampled tariffs for this provider, grouped by vertical and normalized for comparison.
| Plan | Vertical | CPU | RAM | Disk type | GPU | Location | SLA | Price | Action |
|---|---|---|---|---|---|---|---|---|---|
8x NVIDIA B200 SXM6 training · SSD | GPU Servers | 208 | 2,900 GB | 22,528 GB | 8 | USA | — | —/mo | Go to provider |
8x NVIDIA H100 SXM training · SSD | GPU Servers | 208 | 1,800 GB | 22,528 GB | 8 | USA | — | —/mo | Go to provider |
8x NVIDIA A100 SXM 80GB training · SSD | GPU Servers | 240 | 1,800 GB | 19,968 GB | 8 | USA | — | —/mo | Go to provider |
8x NVIDIA A100 SXM 40GB training · SSD | GPU Servers | 124 | 1,800 GB | 5,939 GB | 8 | USA | — | —/mo | Go to provider |
8x NVIDIA Tesla V100 16GB training · SSD | GPU Servers | 88 | 448 GB | 5,939 GB | 8 | USA | — | —/mo | Go to provider |
4x NVIDIA B200 SXM6 training · SSD | GPU Servers | 104 | 1,440 GB | 11,264 GB | 4 | USA | — | —/mo | Go to provider |
4x NVIDIA H100 SXM training · SSD | GPU Servers | 104 | 900 GB | 11,264 GB | 4 | USA | — | —/mo | Go to provider |
4x NVIDIA A100 PCIe 40GB training · SSD | GPU Servers | 120 | 900 GB | 1,024 GB | 4 | USA | — | —/mo | Go to provider |
4x NVIDIA A6000 training · SSD | GPU Servers | 56 | 400 GB | 1,024 GB | 4 | USA | — | —/mo | Go to provider |
2x NVIDIA B200 SXM6 training · SSD | GPU Servers | 52 | 720 GB | 5,632 GB | 2 | USA | — | —/mo | Go to provider |
2x NVIDIA H100 SXM training · SSD | GPU Servers | 52 | 450 GB | 5,632 GB | 2 | USA | — | —/mo | Go to provider |
2x NVIDIA A100 PCIe 40GB training · SSD | GPU Servers | 60 | 450 GB | 1,024 GB | 2 | USA | — | —/mo | Go to provider |
2x NVIDIA A6000 training · SSD | GPU Servers | 28 | 200 GB | 1,024 GB | 2 | USA | — | —/mo | Go to provider |
1x NVIDIA B200 SXM6 inference · SSD | GPU Servers | 26 | 360 GB | 2,816 GB | 1 | USA | — | —/mo | Go to provider |
1x NVIDIA GH200 inference · SSD | GPU Servers | 64 | 432 GB | 4,096 GB | 1 | USA | — | —/mo | Go to provider |
1x NVIDIA H100 SXM inference · SSD | GPU Servers | 26 | 225 GB | 2,816 GB | 1 | USA | — | —/mo | Go to provider |
1x NVIDIA H100 PCIe inference · SSD | GPU Servers | 26 | 225 GB | 1,024 GB | 1 | USA | — | —/mo | Go to provider |
1x NVIDIA A100 SXM 40GB inference · SSD | GPU Servers | 30 | 220 GB | 512 GB | 1 | USA | — | —/mo | Go to provider |
1x NVIDIA A100 PCIe 40GB inference · SSD | GPU Servers | 30 | 225 GB | 512 GB | 1 | USA | — | —/mo | Go to provider |
1x NVIDIA A10 inference · SSD | GPU Servers | 30 | 226 GB | 1,331 GB | 1 | USA | — | —/mo | Go to provider |
1x NVIDIA A6000 inference · SSD | GPU Servers | 14 | 100 GB | 512 GB | 1 | USA | — | —/mo | Go to provider |
1x NVIDIA Quadro RTX 6000 inference · SSD | GPU Servers | 14 | 46 GB | 512 GB | 1 | USA | — | —/mo | Go to provider |
Affiliate link: we may earn a commission if you buy after clicking. Rankings remain editorially independent. Disclosure
Datacenters
USA
- Country
- USA