Skip to main content
DanManREAL/ AI_LAB
Updated Nov 20, 2026Request a test

Public benchmarkExternal source reviewReviewed by Published Source checked Updated

Astra 6.2: new model and public task-evaluation evidence

The report

Public benchmark

Verdict

Published benchmark evidence

Cognition lists Astra 6.2 at 44.2% and $5.97 per rollout. Sol 6.2 is listed at 43.8% and $1.29: a similar published score with substantially different estimated API spend.

On the tier list: The November 17 tier is Dan’s own ranking; public benchmark numbers are a separate evidence channel, not an automatic tier adjustment.

What the benchmarks report

  • FrontierCode 2.0 — Cognition: 44.2%. Astra 6.2; max; Codex harness. Reported by Cognition benchmark operator.
  • FrontierCode 2.0 mean rollout cost: $5.97. Astra 6.2; max; benchmark API-price estimate. Reported by Cognition benchmark operator.
  • Terminal-Bench-Science 0.1 vs Astra 6: 9 percentage points higher. Astra 6.2 relative to GPT-6 Astra; publisher comparison. Reported by OpenAI vendor release.

Original sources

Source 1 — FrontierCode 2.0 — Cognition, FrontierCode 2.0 mean rollout cost.

Source 2 — Terminal-Bench-Science 0.1 vs Astra 6.

What this evidence tells a reader

These Cognition entries allow a narrower comparison than most mixed-benchmark charts: both name FrontierCode 2.0, max effort and a Codex harness. Astra's 44.2% versus Sol's 43.8% is a 0.4-percentage-point difference in the displayed score. Without repeated-run variation, that number is not evidence of a meaningful reliability advantage.

Cognition describes cost as mean USD spend per rollout at list API rates. At $5.97 versus $1.29, Astra's published figure is about 4.6 times Sol's, yet this is not a quote for DanManREAL's subscription, contract, or one actual coding job. The cost/score tradeoff deserves evaluation when tasks have a strict budget.

OpenAI's reported nine-percentage-point science-terminal improvement is a comparison to an earlier Astra version on a separate scientific evaluation. It should not be treated as nine points above Sol on FrontierCode, or as an independently reproduced result.

How to use these results

  • If both models are accessible in the same workflow, start with a representative patch and compare actual cost, diff quality and review effort.
  • Use the Cognition pair for a provisional API-cost discussion, not for predicting subscription charges.
  • Treat scientific-terminal claims as a separate evidence track from repository mergeability.
Cognition's same-listing comparison supports a conditional cost discussion; the release's science claim remains vendor-reported.

Limits of this report

  • The published 0.4-point score gap has no reported confidence interval or repeatability data here.
  • A $5.97 benchmark rollout price and vendor science comparison are not measured workshop spend or a guarantee of production speed.

Follow the lab

New test reports and tier-list changes get announced in my Discord's #news channel. The full videos are on YouTube.

Receipts

4 items

DanManREAL · AI lab

Test receipt

Public benchmarkNov 17, 2026

GPT-6.2 Astra

FrontierCode 2.0 — Cognition
44.2%Cognition benchmark operator (independent operator or secondary publication). Astra 6.2; max; Codex harness. Not independently rerun by DanManREAL.
FrontierCode 2.0 mean rollout cost
$5.97Cognition benchmark operator (independent operator or secondary publication). Astra 6.2; max; benchmark API-price estimate. Not independently rerun by DanManREAL.
Terminal-Bench-Science 0.1 vs Astra 6
9 percentage points higherOpenAI vendor release (model publisher). Astra 6.2 relative to GPT-6 Astra; publisher comparison. Not independently rerun by DanManREAL.
Source review
November 17, 2026Date these source claims were reviewed; not a claim about when the published benchmark was executed.

Verdict

Published benchmark evidence

Tier list The November 17 tier is Dan’s own ranking; public benchmark numbers are a separate evidence channel, not an automatic tier adjustment.

danmanreal.com/tests/gpt-6-2-astra-public-evidence

Models covered by external benchmarks

GPT-6.2 Astra

On the tier list's bench

Related

Independent testing. Sponsorships are always disclosed, and verdicts are never for sale.

Disagree? Bring your receipts

All reports

36 reports