IndexMapAnti-DoomscrollAbout
Model FamilyImageVideo

Segment Anything (SAM)

Also known as: SAM · SAM 2 · SAM 3 · Segment Anything Model

Plain English

Meta AI's family of visual segmentation foundation models that can isolate and track any object in an image or video from a single click, bounding box, or text concept prompt.

Technical Overview

SAM pairs a heavyweight MAE-pretrained ViT (or Hiera hierarchical ViT in SAM 2) image encoder with a lightweight prompt encoder and mask decoder for real-time interactive mask prediction. SAM 2 adds a streaming memory bank and memory attention module to track and segment objects across video frames and occlusions, while SAM 3 unifies open-vocabulary text concept segmentation with visual prompts.

Timeline (4)

RSS
  1. 2023

    Paper

    Kirillov et al. at Meta AI released the Segment Anything Model (SAM) and the SA-1B dataset (1.1 billion masks on 11M images), turning object segmentation into a zero-shot promptable foundation capability driven by points, boxes, or coarse masks—quickly adopted for automatic inpainting masks in ComfyUI.

  2. 2024

  3. 2025

    Release

    Meta AI launched SAM 3 with Promptable Concept Segmentation, enabling open-vocabulary text phrases alongside clicks and boxes to detect, segment, and track every matching object instance across images and video clips.

See also (4)

Open full graph