
AMD / CDNA 3
AMD Instinct MI300X
| Provider / plan | Price / GPU-hour | Rental type | Terms & configuration | Last checked | Provider pricing link |
|---|---|---|---|---|---|
| Runpodbest-on-demand | $2.39Updated 2026-11-22 · 15:43 UTCLowest flexible rate | On-demandNo reservation | 1 GPU minimumSee providerView detailsSecure Cloud: lowest public on-demand GPU-hour list rate among enabled clouds. Not a capacity guarantee; storage/networking extra.
|
2026-11-22Auto-collected | View pricing ↗ |
Prices are dated listings, not live availability. Compare minimum GPU counts and commitments. Storage, networking and taxes may add charges; CPU/RAM inclusion depends on the provider and is shown beside each serverless rate.
MI300X rental prices on xpu live are linked to Runpod. This hardware profile records 192 GB of HBM3 memory and the CDNA 3 architecture. Use this page to compare the exact allocation with its provider offers and source dates.
MI300X specifications and edition
One MI300X OAM accelerator with 192 GB HBM3; 304 compute units and 19,456 stream processors. The platform can contain multiple accelerators; aggregate platform memory is not a single-GPU value.
The recorded form factor is OAM module. Memory bandwidth is 5300 GB/s. Maximum recorded board power is 750 W. These are hardware specifications; the rented host’s CPU, RAM, disk and network allocation are separate resources. Review the offer details for the actual server configuration.
Where to rent MI300X
Compare Runpod in the rental table. Prices are received by the pricing service and linked to this GPU record. A timestamp identifies the observation used for each listing. A missing or unavailable offer does not mean the hardware is free; it means no eligible active price is available in that listing.
For an hourly estimate, multiply the unit rate by the minimum billed allocation and your expected runtime. Storage, data transfer and taxes can add charges. Serverless GPU time may exclude CPU and RAM, while an on-demand machine can be billed for time spent waiting or loading a model. Check the selected plan before deployment.
Model memory and software
Budget memory for weights, KV cache, activations and runtime workspace. Quantization can reduce weight storage, but usable capacity also depends on context length, batch size and the inference engine. Test the intended model and workload rather than treating nominal VRAM as a guarantee that every configuration fits.
Use an AMD ROCm-supported operating system, framework and container for this Instinct accelerator. CUDA-specific extensions require a supported alternative or a port; a CUDA-only image should not be assumed to run on this GPU. Check the ROCm compatibility matrix and the model engine’s supported precision before choosing a host.
Compare MI300X rental costs
Compare the same model, precision, input length and concurrency across candidate machines. Record end-to-end latency, useful throughput and total job cost, including model loading and supporting resources. This makes the comparison more useful than ranking hardware solely by nominal peak arithmetic.
Browse the GPU explorer for other memory capacities and architectures, or compare GPU cloud providers. The specifications and source links below remain separate from current rental availability, so you can review the hardware even when a provider has no capacity.
Review the official MI300X hardware reference and the provider’s checkout conditions before deploying a job. Product images are reference views; the exact installed board and host topology depend on the advertised rental configuration.
CHOOSING THIS GPU
Is it right for your workload?
One MI300X OAM accelerator with 192 GB HBM3; 304 compute units and 19,456 stream processors. The platform can contain multiple accelerators; aggregate platform memory is not a single-GPU value.
Best suited to
- Inference and development workloads that fit the recorded memory configuration
- Task-specific benchmarking with the intended model, precision and software
- Comparing hourly rental options for this exact hardware identity
Strengths
- 192 GB recorded nominal memory
- CDNA 3 architecture
- Provider-specific pricing and observation timestamps
Things to consider
- Rental availability and included CPU/RAM vary by provider
- Storage, networking and multi-GPU minimums can change the final cost
- Different form factors and partition sizes are separate catalog entries
HARDWARE DETAILS
Inside the GPU
One MI300X OAM accelerator with 192 GB HBM3; 304 compute units and 19,456 stream processors. The platform can contain multiple accelerators; aggregate platform memory is not a single-GPU value.
Image: MI300X reference product view. Source: AMD.
- Manufacturer
- AMD
- Architecture
- CDNA 3
- VRAM (GB)
- 192
- Memory type
- HBM3
- Form factor
- OAM module
- Memory bandwidth (GB/s)
- 5300
- Maximum board power (W)
- 750
- CUDA cores
- Not verified for this edition
- Tensor cores
- 1,216 AMD Matrix Cores; not NVIDIA Tensor Cores
- Ray tracing cores
- Not verified for this edition
- CUDA capability
- Not verified for this edition
- Memory ECC
- Supported; full-chip ECC memory
- Host interface
- PCIe Gen5 x16
- GPU interconnect
- Not verified for this edition
- Hardware partitioning (MIG)
- Not verified for this edition
- Cooling
- Not verified for this edition
Hardware capabilities are not a guarantee of access in a cloud instance. Check the exact edition, GPU allocation and server topology in the rental offer.
MODEL MEMORY
Plan your model size
Weight memory is approximately parameter count × bytes per parameter; allow additional capacity for KV cache, activations and runtime workspace. Nominal VRAM alone does not establish that a model fits. MIG capacity is the allocation size, not total parent GPU memory.
| Example model class | Weight format | Raw weights ≈ | Minimum GPUs for weights only |
|---|---|---|---|
| Llama 3.1 8B ↗ | 4-bit | 4 GB | 1Runtime needs more memory |
| Llama 3.1 8B ↗ | FP16 | 16 GB | 1Runtime needs more memory |
| Qwen2.5 14B ↗ | 4-bit | 7 GB | 1Runtime needs more memory |
| Qwen2.5 32B ↗ | 4-bit | 16 GB | 1Runtime needs more memory |
| Llama 3.1 70B ↗ | 4-bit | 35 GB | 1Runtime needs more memory |
| Llama 3.1 70B ↗ | 8-bit | 70 GB | 1Runtime needs more memory |
| Llama 3.1 70B ↗ | FP16 | 140 GB | 1Runtime needs more memory |
Arithmetic lower bound: rounded parameter count × bits per weight ÷ 8, in decimal GB. Excludes quantization metadata, KV cache, activations, CUDA workspaces and training states. Actual model sizes differ from their rounded names. No context length, batch size or concurrency is guaranteed. GPU counts assume supported model sharding and can be higher in practice. Quantized checkpoints and compatible kernels are required for 4-bit/8-bit execution.
SOFTWARE & PERFORMANCE
Before you deploy
Software compatibility
AMD ROCm-compatible framework and driver are required. Check the exact supported ROCm release, kernel and container; CUDA-only binaries do not run unchanged on AMD hardware.
Measured benchmarks
A reproducible, comparable application benchmark has not yet been recorded for this edition. Peak TFLOPS above are not measured tokens per second or image-generation speed.
Compare tests using the same model, precision, GPU count, engine version, input/output length and batch or concurrency. A provider’s server configuration can change the result.
COMPARE YOUR OPTIONS
Alternatives to consider
BUDGET YOUR RUN
GPU cost estimator
GPU compute only: hourly rate × billable hours × GPU count. CPU, RAM, storage, egress, taxes, billing increments and minimum terms may add charges. Serverless hours mean active GPU task time; spot capacity can be interrupted. Reserved commitments and quote-only offers are excluded from this simple hourly estimator.
