IndexMapAnti-DoomscrollAbout
ConceptLLMImageVideoCross-Modal

Custom AI Accelerators

Also known as: AI ASICs · Inference silicon · Purpose-built AI accelerators

Plain English

Custom AI accelerators are chips and systems built around common neural-network operations. They include Google TPUs, AWS Inferentia and Trainium, and wafer-scale designs from Cerebras.

Technical Overview

Specialized systems balance matrix throughput, memory capacity and bandwidth, and inter-chip communication around a particular workload. TPUs use systolic arrays, while wafer-scale systems keep more data movement within one piece of silicon. Performance depends on the compiler and runtime as well as the workload, so benchmarks should distinguish time to first token, generation speed, and sustained throughput.

Timeline (4)

RSS
  1. 2017

  2. 2019

  3. 2024

  4. 2025

See also (6)

Open full graph
1 more connection