IndexMapAnti-DoomscrollAbout
Model FamilyLLM

Olmo (Open Language Model)

Also known as: OLMo · OLMoE · Open Language Model

Plain English

Olmo is a family of language models from the Allen Institute for AI. Ai2 publishes training data, code, and intermediate checkpoints so researchers can study how the models were built.

Technical Overview

Olmo releases expose artifacts across pretraining, midtraining, and post-training, with coverage varying by release. Intermediate Checkpoints and data mixtures make comparative experiments possible across training stages. The family includes dense Transformers, the sparse OLMoE branch, and a hybrid branch that combines attention and linear recurrence.

Timeline (4)

RSS
  1. 2024

    Release

    Ai2 released OLMo with weights, training code, and the Dolma corpus. Researchers could inspect data and intermediate checkpoints while studying how training changed the model.

  2. 2025

  3. 2026

See also (6)

Open full graph
1 more connection