IndexMapAnti-DoomscrollAbout
ConceptImageCross-Modal

Vision-Language-Action Models

Also known as: VLA · Robot foundation models · OpenVLA · RT-2 · π0

Plain English

A vision-language-action model uses images and instructions to decide what a robot should do next. Its outputs can control a robot’s movement or manipulation of objects.

Technical Overview

A VLA extends a vision-language backbone with an action representation. The policy can predict discretized action tokens or generate multiple continuous control steps together with methods such as flow matching. Results depend on the robot hardware, the demonstrations used for training, and how the policy is evaluated on unfamiliar tasks or environments.

Timeline (4)

RSS
  1. 2023

  2. 2024

  3. 2026

See also (4)

Open full graph