IndexMapAnti-DoomscrollAbout
ConceptLLMImageVideoCross-Modal

Google Tensor Processing Units (TPUs)

Also known as: Google TPU · Cloud TPU · Tensor Processing Unit

Plain English

A Tensor Processing Unit is a Google-designed chip that speeds up the matrix operations used to train and run neural networks. Google connects multiple TPUs so they can work on models that exceed the capacity of a single chip.

Technical Overview

TPUs use systolic matrix multiplication units that move intermediate values directly between neighboring processing elements. Later generations add high-bandwidth memory and inter-chip links for distributed training and inference. Frameworks such as JAX use XLA compilation to map programs and their sharding layouts onto the hardware.

Timeline (5)

RSS
  1. 2017

  2. 2023

  3. 2025

  4. 2026

See also (6)

Open full graph
1 more connection