Runner Specifications
Available GPU Runners
Choose from a variety of GPU instances to power your machine learning and AI workflows
| GPU | vCPU | RAM | VRAM | Arch | Spot Credits | On Demand Credits |
|---|---|---|---|---|---|---|
| T4 | ||||||
| 4 | 16 | 16 | X64 | 2 | 4 | |
| 8 | 32 | 16 | X64 | 2 | 6 | |
| 16 | 64 | 16 | X64 | 3 | 9 | |
| L4 | ||||||
| 4 | 16 | 24 | X64 | 2 | 6 | |
| 8 | 32 | 24 | X64 | 2 | 7 | |
| 16 | 64 | 24 | X64 | 3 | 9 | |
| L40S | ||||||
| 4 | 32 | 48 | X64 | 3 | 14 | |
| 8 | 64 | 48 | X64 | 5 | 15 | |
| 16 | 128 | 48 | X64 | 6 | 21 | |
| T4G | ||||||
| 4 | 8 | 16 | ARM64 | 1 | 3 | |
| 8 | 16 | 16 | ARM64 | 2 | 4 | |
| 16 | 32 | 16 | ARM64 | 3 | 6 | |
| A10G | ||||||
| 4 | 16 | 24 | X64 | 3 | 7 | |
| 8 | 32 | 24 | X64 | 3 | 9 | |
| 16 | 64 | 24 | X64 | 4 | 11 | |
| TRAINIUM | ||||||
| 8 | 32 | 32 | X64 | 1 | 9 | |
| INFERENTIA2 | ||||||
| 4 | 16 | 32 | X64 | 1 | 6 | |
| 32 | 128 | 32 | X64 | 3 | 14 | |
Note: These rates are only indicative and subject to change based on AWS pricing, and represent the lowest cost achievable across all regions at the time of writing.
Need a custom runner configuration? Contact us