IndexMapAnti-DoomscrollAbout
Format / ProtocolLLMImageCross-Modal

ONNX

Also known as: Open Neural Network Exchange · ONNX Runtime · ORT

Plain English

A shared file format for neural networks that lets a model trained in one framework run in another. ONNX Runtime is the engine most people use to run those files on CPUs, GPUs, phones, and browsers.

Technical Overview

ONNX stores a model as a serialized computation graph of standardized operators plus weights, so exporters in frameworks such as PyTorch can target one intermediate representation. ONNX Runtime loads the graph, applies graph optimizations and operator fusion, and dispatches to hardware through pluggable execution providers; its GenAI library adds the tokenizer, KV-cache, and sampling loop for LLMs. Unlike Safetensors, which only stores tensors, ONNX also encodes the compute graph, which suits portable deployment but needs operator coverage for new architectures. Quantization such as int4 is applied at export time.

Timeline (7)

RSS
  1. 2017

  2. 2018

  3. 2019

    Milestone

    ONNX Runtime 1.0.0 was published to PyPI, marking the first stable release of the runtime that later became the default way to deploy ONNX models.

  4. 2024

  5. 2025

  6. 2026

    Release

    ONNX Runtime 1.32.0 shipped on PyPI with Python 3.11–3.14 packages for x86-64 and Arm64 Linux and Windows, and for Arm64 macOS. The wheels support running exported ONNX graphs on those platforms.

See also (6)

Open full graph
1 more connection