IndexMapAnti-DoomscrollAbout
Model FamilyLLMImageCross-Modal

Phi

Also known as: Microsoft Phi · Phi-1 · Phi-2 · Phi-3 · Phi-3.5 · Phi-4

Plain English

Microsoft Research's family of open-weight Small Language Models (SLMs) that proved compact 1.3B–15B parameter models trained on curated 'textbook-quality' synthetic data can rival models an order of magnitude larger.

Technical Overview

Developed by Microsoft Research, the Phi lineage (Phi-1 through Phi-4) combines multi-agent Synthetic Data & Self-Play generation, strict web-corpus quality filtering, pivotal-token DPO, Mixture-of-LoRAs multimodal routing (LoRA adapters for vision and speech over a frozen language backbone), and RL test-time reasoning—making it a staple for on-device quantized inference via GGUF and Ollama.

Timeline (6)

RSS
  1. 2023

  2. 2024

  3. 2025

See also (14)

Open full graph
9 more connections