IndexMapAbout
Tool / RuntimeCross-ModalLLMImageVideo

PyTorch

Also known as: torch · torch.compile · FSDP

Plain English

The dominant open-source Python framework for building, training, and running neural networks, prized for feeling like ordinary Python code while still executing at full GPU speed.

Technical Overview

Originated at Meta AI and now governed by the PyTorch Foundation, PyTorch pairs eager-mode automatic differentiation with a C++ / CUDA tensor runtime, torch.compile (TorchDynamo + TorchInductor) graph compilation, and native distributed training primitives (DDP, FSDP2, Tensor Parallelism). It serves as the primary training and model-authoring substrate beneath Hugging Face, vLLM, SGLang, and TensorRT-LLM.

Chronological Entries (2)

#2Release
AI-Assisted

The PyTorch team released PyTorch 2.0, introducing torch.compile (TorchDynamo + TorchInductor + Triton codegen) to capture Python execution graphs and emit fused GPU kernels automatically while preserving eager-mode ergonomics.

Direct Relations (4)

Referenced By (1)