IndexMapAnti-DoomscrollAbout
Model FamilyVideo

CogVideo & CogVideoX

Also known as: CogVideo · CogVideoX · CogVideoX-5B

Plain English

Tsinghua KEG and Zhipu AI's family of open-weight video generation models that pioneered full 3D spatiotemporal attention and 3D causal VAEs in the open-source video ecosystem.

Technical Overview

While early video models stacked separate 1D temporal attention layers onto 2D image networks, CogVideoX paired a 3D causal VAE (4x8x8 compression) with an Expert Diffusion Transformer using full 3D attention and Expert Adaptive LayerNorm to align T5 text embeddings with spatiotemporal video tokens.

Timeline (4)

RSS
  1. 2022

  2. 2024

  3. Release

    The CogVideo team released CogVideoX-5B (followed by CogVideoX-5B-I2V for image-to-video in September 2024), scaling the Expert DiT backbone to 5 billion parameters and establishing the primary open-weight video LoRA fine-tuning target of late 2024.

  4. Release

    Zhipu AI and Tsinghua released CogVideoX1.5-5B (T2V and I2V), upgrading the open-weight family to 10-second clips at 768p–1360p resolution with arbitrary aspect-ratio support.

See also (11)

Open full graph
6 more connections