Skip to main content
DanManREAL/ AI_LAB
Updated Nov 20, 2026Request a test

Public benchmarkExternal source reviewReviewed by Published Source checked Updated

Fable 5.2: agentic coding benchmark source review

The report

Public benchmark

Verdict

Published benchmark evidence

Two FrontierCode 2.0 publications report 49.1% and 50.2%, but their runs and operators differ. The small gap is not a measured model improvement or a local win.

On the tier list: The November 17 tier is Dan’s own ranking; public benchmark numbers are a separate evidence channel, not an automatic tier adjustment.

What the benchmarks report

  • FrontierCode 2.0 — Anthropic: 49.1%. Fable 5.2; Xhigh effort; publisher evaluation. Reported by Anthropic vendor table.
  • FrontierCode 2.0 — Cognition: 50.2%. Fable 5.2; xhigh; Claude Code harness; separate run. Reported by Cognition benchmark operator.
  • FrontierSWE v2: 69.9%. Fable 5.2; agentic coding benchmark. Reported by Anthropic vendor table.

Original sources

Source 1 — FrontierCode 2.0 — Anthropic, FrontierSWE v2.

Source 2 — FrontierCode 2.0 — Cognition.

What this evidence tells a reader

FrontierCode 2.0 evaluates merge-worthy software changes, not simply whether code passes one test. The Anthropic-published 49.1% and Cognition-published 50.2% are separate evaluations; even for the same named suite, effort settings, harness details and run conditions can affect the outcome. Averaging the two or calling the 1.1-point gap a performance gain would hide those differences.

The 69.9% FrontierSWE v2 result covers a different coding assessment. It can add evidence that Fable was evaluated on agentic software work, but it cannot be ranked against a FrontierCode percentage. A high test score also leaves practical questions about reviewable diffs, unexpected file edits and the number of human corrections.

A useful next experiment is one real repository issue run with fixed instructions and a recorded harness, then compare the patch's acceptance, time, edits outside scope and review cost. This is a proposed reader method, not a test DanManREAL claims to have carried out for this page.

How to use these results

  • Treat the two FrontierCode records as a range of published observations, not interchangeable trials.
  • Prioritize a small code-maintenance trial with code review and tests before selecting a long-running agent.
  • Check whether the chosen Claude Code harness and effort setting match the run behind the claimed score.
Anthropic vendor table and Cognition operator result are two evidence sources; neither is represented as a DanManREAL execution.

Limits of this report

  • The two FrontierCode values were published by different operators under distinct runs; no common repeated-trial distribution is provided.
  • The FrontierSWE result is a separate suite and says nothing by itself about local subscriptions, speed, or unexpected edits.

Follow the lab

New test reports and tier-list changes get announced in my Discord's #news channel. The full videos are on YouTube.

Receipts

4 items

DanManREAL · AI lab

Test receipt

Public benchmarkNov 17, 2026

Claude Fable 5.2

FrontierCode 2.0 — Anthropic
49.1%Anthropic vendor table (model publisher). Fable 5.2; Xhigh effort; publisher evaluation. Not independently rerun by DanManREAL.
FrontierCode 2.0 — Cognition
50.2%Cognition benchmark operator (independent operator or secondary publication). Fable 5.2; xhigh; Claude Code harness; separate run. Not independently rerun by DanManREAL.
FrontierSWE v2
69.9%Anthropic vendor table (model publisher). Fable 5.2; agentic coding benchmark. Not independently rerun by DanManREAL.
Source review
November 17, 2026Date these source claims were reviewed; not a claim about when the published benchmark was executed.

Verdict

Published benchmark evidence

Tier list The November 17 tier is Dan’s own ranking; public benchmark numbers are a separate evidence channel, not an automatic tier adjustment.

danmanreal.com/tests/claude-fable-5-2-public-evidence

Models covered by external benchmarks

Claude Fable 5.2

On the tier list's bench

Related

Independent testing. Sponsorships are always disclosed, and verdicts are never for sale.

Disagree? Bring your receipts

All reports

36 reports