FIFoundationIndex
IndexMapAbout
ConceptLLMCross-Modal

Post-Training (SFT, RLHF, DPO & GRPO)

Also known as: RLHF · DPO · GRPO · SFT · Alignment · Reasoning RL

Plain English

Everything done to a model after initial pre-training to turn a raw text-autocomplete engine into a helpful, safe assistant or a multi-step reasoning model that checks its own work.

Technical Overview

Post-training typically stages Supervised Fine-Tuning (SFT) on instruction/tool traces followed by preference optimization (RLHF via PPO, or reward-model-free DPO) and Reinforcement Learning with Verifiable Rewards (RLVR / GRPO). Verifiable RL on math, code, and agent tasks became the primary driver of test-time reasoning models.

Chronological Entries (2)