IndexMapAnti-DoomscrollAbout
Tool / RuntimeLLMImageVideoCross-Modal

AMD ROCm & Instinct

Also known as: ROCm · AMD Instinct · AMD HIP

Plain English

ROCm is AMD’s software stack for running compute and machine learning workloads on its GPUs. Instinct is the data-center GPU family commonly paired with it for model training and serving.

Technical Overview

ROCm combines the HIP programming model with a compiler, GPU runtime, tuned numerical libraries, and collective communication. PyTorch and serving engines such as vLLM have ROCm builds. Porting a CUDA kernel also requires checking supported operations, GPU targets, and the performance of the substituted libraries.

Timeline (4)

RSS
  1. 2023

  2. 2024

  3. 2025

  4. Release

    ROCm 7.1.1 added Ubuntu 24.04 guest support for SR-IOV on the Instinct MI300X. This expanded the supported combinations for exposing GPU resources to virtual machines.

See also (4)

Open full graph