Skip to main content
DanManREAL/ AI_LAB
Updated Nov 20, 2026Request a test

Public benchmarkExternal source reviewReviewed by Published Source checked Updated

GLM-5.3: public coding benchmark receipts

The report

Public benchmark

Verdict

Published benchmark evidence

Z.ai reports 66.9% on DeepSWE v1.1, 42.5% on SWE-Marathon v1.1 and 28.3% on the older Terminal-Bench 3.0: different tasks and benchmark generations.

On the tier list: The November 17 tier is Dan’s own ranking; public benchmark numbers are a separate evidence channel, not an automatic tier adjustment.

What the benchmarks report

  • DeepSWE v1.1: 66.9%. GLM-5.3; mini-swe-agent harness. Reported by Z.ai vendor release.
  • Terminal-Bench 3.0: 28.3%. GLM-5.3; Claude Code 2.1.207; max effort; avg@3. Reported by Z.ai vendor release.
  • SWE-Marathon v1.1: 42.5%. GLM-5.3; long-horizon software engineering. Reported by Z.ai vendor release.

Original sources

Source 1 — DeepSWE v1.1, Terminal-Bench 3.0, SWE-Marathon v1.1.

What this evidence tells a reader

DeepSWE v1.1 at 66.9% uses the mini-swe-agent harness, while the 28.3% Terminal-Bench 3.0 figure names Claude Code 2.1.207 at max effort and avg@3. That last notation changes the interpretation: the reported value reflects the publisher's aggregation method, not necessarily a single run a developer will experience.

Terminal-Bench 3.0 must not be placed directly beside Terminal-Bench 4.0 values for Opus, Sonnet or Kimi as though they were common-exam rankings. SWE-Marathon v1.1's 42.5% offers evidence about another category—longer engineering work—but it cannot calibrate the earlier terminal percentage.

Readers selecting GLM for a coding agent should begin with a fixed project repair and record code correctness, task completion, tool compatibility and review time. A vendor's three-table profile is useful for deciding what to test next, not enough to declare a cost-efficient winner.

How to use these results

  • Check both benchmark generation and harness before making cross-model comparisons.
  • Treat avg@3 separately from single-attempt success.
  • Run a representative multi-step fix and count accepted patches and correction passes.
Z.ai is the publishing model vendor; this source review makes no firsthand GLM coding-performance claim.

Limits of this report

  • The cited results were published in Z.ai's model release, without an independent matched local reproduction here.
  • Different suite generations and aggregation rules prevent a reliable score ranking against Terminal-Bench 4.0 pages.

Follow the lab

New test reports and tier-list changes get announced in my Discord's #news channel. The full videos are on YouTube.

Receipts

4 items

DanManREAL · AI lab

Test receipt

Public benchmarkNov 17, 2026

GLM-5.3

DeepSWE v1.1
66.9%Z.ai vendor release (model publisher). GLM-5.3; mini-swe-agent harness. Not independently rerun by DanManREAL.
Terminal-Bench 3.0
28.3%Z.ai vendor release (model publisher). GLM-5.3; Claude Code 2.1.207; max effort; avg@3. Not independently rerun by DanManREAL.
SWE-Marathon v1.1
42.5%Z.ai vendor release (model publisher). GLM-5.3; long-horizon software engineering. Not independently rerun by DanManREAL.
Source review
November 17, 2026Date these source claims were reviewed; not a claim about when the published benchmark was executed.

Verdict

Published benchmark evidence

Tier list The November 17 tier is Dan’s own ranking; public benchmark numbers are a separate evidence channel, not an automatic tier adjustment.

danmanreal.com/tests/glm-5-3-public-benchmarks

Models covered by external benchmarks

GLM-5.3

On the tier list's bench

Related

Independent testing. Sponsorships are always disclosed, and verdicts are never for sale.

Disagree? Bring your receipts

All reports

36 reports