AMD launched Instinct MI300X and MI300A alongside ROCm 6. MI300X supplied 192 GB of high-bandwidth memory per accelerator, while ROCm 6 added support for FlashAttention and vLLM.
AMD ROCm & Instinct
Also known as: ROCm · AMD Instinct · AMD HIP
Plain English
ROCm is AMD’s software stack for running compute and machine learning workloads on its GPUs. Instinct is the data-center GPU family commonly paired with it for model training and serving.
Technical Overview
ROCm combines the HIP programming model with a compiler, GPU runtime, tuned numerical libraries, and collective communication. PyTorch and serving engines such as vLLM have ROCm builds. Porting a CUDA kernel also requires checking supported operations, GPU targets, and the performance of the substituted libraries.
Timeline (4)
2023
Release2024
ReleaseROCm 6.3.1 added official support for the Instinct MI325X, bringing the higher-memory accelerator into the supported ROCm software stack.
2025
ReleaseROCm 7.0.1 included certified support for Instinct MI350X and MI355X, establishing a software baseline for deployments on AMD’s CDNA 4 data-center GPUs.
- Release
ROCm 7.1.1 added Ubuntu 24.04 guest support for SR-IOV on the Instinct MI300X. This expanded the supported combinations for exposing GPU resources to virtual machines.