The Meta AI (Llama) Lineage: A Consolidated Comparison
A sixth lab, and the first whose defining choice is a distribution strategy rather than a single model: since February 2023, Meta has published Llama's weights more openly than any other frontier lab in this project, then spent 2025 openly reconsidering that bet after a benchmark-gaming scandal, a stalled flagship model, and a copyright lawsuit. This article covers the full lineage โ Llama 1 through Llama 4's Scout, Maverick, and the still-unreleased Behemoth โ the open-weight license that a standards body says isn't actually open source, the LMArena controversy, the Kadrey v. Meta copyright case, and the 2025 reorganization into Meta Superintelligence Labs โ closing with the first six-way comparison across every lab this site has documented.
The Lab That Bet on Openness, Then Second-Guessed It
Every lab this project has covered eventually made a defining bet: OpenAI bet on scale, Anthropic bet on safety-first pacing, Google DeepMind bet on integration, xAI bet on speed, DeepSeek bet on efficiency. Meta's bet was distribution โ release capable model weights openly enough that they become the default substrate other companies, researchers, and even rival labs build on. That bet mostly worked for three years. Then, in 2025, a chat-tuned Llama 4 variant quietly submitted to a public benchmark was caught being materially different from the model everyone else could download, the largest planned model in the family stalled and was never released, and Meta's own reporting suggests the company began weighing a partial retreat from full openness at the frontier. This article treats that arc honestly โ Meta's open-weight releases are real and were genuinely influential, and the retreat from full openness is also real and not yet resolved.
From FAIR to Four Llama Generations to a Reorg
From FAIR to GenAI to Meta Superintelligence Labs
Meta's AI research traces back to Facebook AI Research (FAIR), founded in 2013 under Yann LeCun, who spent roughly twelve years as the company's Chief AI Scientist before departing in November 2025. Unlike DeepMind or OpenAI, Meta's Llama models were not FAIR's direct product โ they came out of a separate "GenAI" organization built specifically to ship consumer- and developer-facing generative AI products, while FAIR continued longer-horizon fundamental research. That split, and the tension between shipping speed and research depth it implied, ran through the entire Llama era and became the explicit subject of Meta's 2025 reorganization (covered in a dedicated section below).
Compute-Efficient Small Models, Leaked Within a Week
- Research Trigger
- Test the Chinchilla compute-optimal scaling thesis directly โ train smaller dense models on far more tokens than prior practice, aiming to beat larger, under-trained models at inference time rather than chase parameter count.
- Network Architecture
- Dense transformer at four sizes โ 7B, 13B, 33B, and 65B parameters.
- Data
- Trained entirely on publicly available data (no proprietary or licensed corpora) โ roughly 1 trillion tokens for the 7B/13B models and roughly 1.4 trillion tokens for the 33B/65B models, drawn from sources including CommonCrawl, C4, GitHub, Wikipedia, books, and ArXiv.
- Influence on Next
- Despite a research-only, gated, non-commercial license, the weights leaked publicly within about a week of announcement, spreading uncontrolled across the open community โ the direct trigger for Llama 2's shift to a genuinely commercial license seven months later, an attempt to get ahead of unauthorized redistribution rather than fight it.
Meta's own reported benchmarks claimed Llama 1's 13B model outperformed GPT-3's 175B model on most evaluated benchmarks, and the 65B model was competitive with Chinchilla-70B and PaLM-540B โ a genuinely disclosed, testable claim about training efficiency, three years before DeepSeek made a similar claim the center of a much larger controversy.
The First Truly Commercial Open-Weight Frontier Model
- Network Architecture
- Dense transformer at 7B, 13B, and 70B (a 34B variant was trained but held back from release pending further safety review); context length doubled to 4,096 tokens.
- Training Technique
- RLHF pipeline built around a reward model with a scalar regression head trained on human preference comparisons, combining a modified binary ranking loss with rejection-sampling fine-tuning (used for the 70B model) and PPO balancing separate helpfulness and safety reward signals.
- Learning Technique & Scaffolding
- Ghost Attention (GAtt), a context-distillation-derived technique that keeps a system-prompt-level instruction present across many conversational turns, fixing a common multi-turn instruction-forgetting failure.
- Safety Framework
- Iterative red-teaming across model versions, evaluated with human ratings on roughly 2,000 adversarial prompts spanning risk categories (dangerous activities, hate speech, unqualified professional advice) in both single-turn and multi-turn settings.
Llama 2's license was the first in the family to permit genuine commercial use, distributed alongside a partnership placing the models on Microsoft Azure โ a distribution choice that made Llama 2 the first realistic "download a frontier-adjacent model and ship a product" option most companies had.
Four Releases in Nine Months
The First MoE Llama, and a Benchmark Scandal
- Network Architecture
- Meta's first Mixture-of-Experts Llama family, with native multimodality built in from pretraining rather than added afterward. Scout was marketed with an unusually large 10-million-token context window claim.
- Influence on Next
- Behemoth, the largest model in the family, was originally planned to launch alongside Scout and Maverick at Meta's first LlamaCon developer conference, then pushed to June 2025, then to fall 2025 or later. As of the most recent available reporting it remains unreleased and undated โ not formally cancelled, but effectively shelved after reported mid-training issues with MoE routing and chunked attention at roughly 2-trillion-parameter scale; Meta reportedly used it internally as a "teacher model" to help train Scout and Maverick via distillation instead.
The Most Prominent Open-Weight Strategy at Frontier Scale โ With a Catch
Of every lab this project has covered, Meta has released the most capable models with the most permissive-sounding licenses most consistently โ GPT-1 and Grok-1 were each open-weighted once; DeepSeek released V3 and R1 openly; Meta has done this across four full generations. But the Llama Community License is explicitly not an OSI-approved open-source license. It layers an Acceptable Use Policy, attribution and naming requirements, and โ starting with Llama 3.1 โ a hard commercial restriction on top of the free grant.
The Open Source Initiative's own review, and a separate Free Software Foundation evaluation, both concluded the license fails core open-source tests: it restricts Freedom 0 (use for any purpose), discriminates against certain classes of user (later license versions reportedly excluded persons located in the EU from some capabilities), and restricts fields of endeavor through the Acceptable Use Policy and the MAU cap. Meta's own marketing language calls Llama "open source"; the standards bodies that define that term disagree. This project uses "open weight" rather than "open source" for Llama throughout, for the same reason it does for DeepSeek and Grok-1.
A Copyright Case, and a Refused EU Code
Meta Superintelligence Labs, and the Departure of Yann LeCun
In mid-2025, Meta invested $14.3 billion to bring in Scale AI founder Alexandr Wang as Chief AI Officer โ one of the most expensive individual talent acquisitions in the industry's history. On August 19, 2025, Meta formalized a reorganization into Meta Superintelligence Labs (MSL), split into four units: TBD Lab (led directly by Wang, focused on next-generation LLMs powering the Meta AI assistant), FAIR (now led by Rob Fergus, focused on long-term fundamental research), Products and Applied Research, and MSL Infra (compute and datacenter operations). Yann LeCun, after roughly twelve years as Chief AI Scientist, departed Meta in November 2025 following the restructuring โ he was reportedly asked to report to Wang, and publicly described Wang afterward as "young and inexperienced," warning that other researchers were leaving as well.
Three Patterns Unique to This Lineage
OpenAI, Anthropic, Google DeepMind, xAI, DeepSeek, and Meta
| Dimension | OpenAI | Anthropic | Google DeepMind | xAI | DeepSeek | Meta |
|---|---|---|---|---|---|---|
| Origin story | A research paper (2018) | A safety-pace disagreement (2021) | A corporate merger (2023) | A founder-led startup (2023) | A hedge fund's AI research spinoff (2023) | A social media company's research lab (2013), later split into FAIR + GenAI + MSL |
| Architecture disclosure | Open, then closed | Undisclosed from day one | Partial (e.g., confirmed MoE) | Open once (Grok-1), closed since | Detailed and disclosed (MLA, MoE routing, exact params) | Open weights across four generations, but under a non-OSI license |
| Compute disclosure | Precise (GPT-1, GPT-3), then none | Never disclosed | Never disclosed | Never disclosed | Disclosed, but disputed and contested by outside analysis | Precisely disclosed for Llama 3.1 (GPU count, FLOPs), silent since |
| Safety framework type | Voluntary capability-risk framework | Voluntary capability-risk framework | Voluntary capability-risk framework | Voluntary framework, publicly criticized as weak | State-mandated political-content compliance regime | Voluntary Frontier AI Framework (Feb 2025), paired with Purple Llama's Llama Guard content classifiers |
| Most consequential public event | GPT-6 Astra's "Critical" classification | Opus 4/Sonnet 4's ASL-3 activation | No CCL reached to date | The MechaHitler incident | A $600B single-day market shock | The LMArena benchmark-gaming scandal |
| National government bans | None documented | None documented | None documented | None documented | Italy (app store removal), Australia (government devices) | None documented; refused to sign the EU AI Act's voluntary Code of Practice |
The Same Foundation, a Sixth Time
Llama 4's Mixture-of-Experts architecture is, once again, a variation on the same 2017 Transformer design every model in this six-lab project shares. Six labs, six founding stories, six disclosure philosophies, six different relationships with openness and government oversight โ and underneath every one of them, including the lab that built its entire public identity around giving its weights away, the same architectural family.
Readiness Checklist
โ ๏ธ What's Missing or Uncertain
๐ Reference Links
- Meta AI โ "The Llama 3 Herd of Models" (arXiv:2407.21783)
- Open Source Initiative โ "Meta's Llama License Is Still Not Open Source"
- Meta โ "Our Approach to Frontier AI" (Frontier AI Framework, Feb 2025)
- TechCrunch โ "Meta's 'Vanilla' Maverick AI Model Ranks Below Rivals on a Popular Chat Benchmark"
- TechCrunch โ "Mark Zuckerberg Gave Meta's Llama Team the OK to Train on Copyrighted Works, Filing Claims"
- CNBC โ "Meta Won't Sign Europe's AI Code of Practice"
- This site โ Model Case Study: GPT-1 (the other early open-weights precedent)
- This site โ The DeepSeek Lineage: A Consolidated Comparison
- This site โ The Grok Lineage: A Consolidated Comparison
- This site โ The GPT Lineage: A Consolidated Comparison
- This site โ The Claude Lineage: A Consolidated Comparison
- This site โ The Gemini Lineage: A Consolidated Comparison
- This site โ The Mistral AI Lineage: A Consolidated Comparison
- This site โ The Qwen Lineage: A Consolidated Comparison
- This site โ The AI Researcher Atlas: 50 People Who Built the Field