FIFoundationIndex
IndexMapAbout
Model FamilyLLMCross-Modal

Llama

Also known as: Llama 3 · Llama 4 · Meta Llama

Plain English

Meta's flagship family of open-weight language and multimodal models. For years, Llama served as the reference architecture around which almost every open-source LLM runtime, fine-tuning tool, and quantization format was built.

Technical Overview

Beginning as dense decoder-only Transformers (Llama 1–3, scaling from 1B to 405B parameters with 128k vocab and GQA KV Cache), the lineage evolved in Llama 4 to native multimodal sparse Mixture of Experts (MoE) models distributed as Safetensors on Hugging Face and widely served via Inference Engines (vLLM, SGLang, llama.cpp).

Chronological Entries (2)

Direct Relations (4)