Skip to main content
DanManREAL/ AI_LAB
Updated Nov 20, 2026Request a test

Public benchmarkExternal source reviewReviewed by Published Source checked Updated

DeepSeek V4.1 Flash: public coding benchmark receipts

The report

Public benchmark

Verdict

Published benchmark evidence

The 74.2% DeepSWE and 31.2% Terminal-Bench figures refer to original V4.1 Flash, not the later Flash-1017 revision; ProgramBench 20.3 is not labeled as a percentage.

On the tier list: The November 17 tier is Dan’s own ranking; public benchmark numbers are a separate evidence channel, not an automatic tier adjustment.

What the benchmarks report

  • DeepSWE v1.1: 74.2%. Original V4.1 Flash, not Flash-1017; Mini-SWE-V2. Reported by DeepSeek vendor comparison table.
  • Terminal-Bench 4.0: 31.2%. Original V4.1 Flash, not Flash-1017; Claude Code harness. Reported by DeepSeek vendor comparison table.
  • ProgramBench: 20.3. Original V4.1 Flash; metric as published. Reported by DeepSeek vendor comparison table.

Original sources

Source 1 — DeepSWE v1.1, Terminal-Bench 4.0, ProgramBench.

What this evidence tells a reader

The cited model card belongs to Flash-1017 but contains a comparison column for original V4.1 Flash. This page deliberately draws 74.2% DeepSWE v1.1 and 31.2% Terminal-Bench 4.0 from the original column. Anyone using a service alias needs to verify which checkpoint the service actually routes to before using either figure.

The DeepSWE result names a Mini-SWE-V2 harness, while Terminal-Bench uses Claude Code. The score gap reflects different tasks and tool setups, not a controlled demonstration of a coding weakness. ProgramBench is reported as 20.3 with the publisher's scale; adding a percent sign would invent a metric.

DanManREAL has separate DeepSeek usage-cost and session-audit records. Those firsthand data answer billing and workflow questions, not the benchmark's success rate. They are useful complements when deciding whether a cheap model is economical after retries and human repair.

How to use these results

  • Resolve the precise Flash or Flash-1017 checkpoint before comparing benchmark figures.
  • Measure successful accepted tasks and end-to-end spend rather than only tokens and score headlines.
  • Keep ProgramBench's published metric notation intact until its scoring scale is independently established.
An original-versus-1017 variant distinction is essential; linked billing evidence is not a benchmark replication.

Limits of this report

  • The provider comparison table and the local deepseek-flash alias do not establish an identical checkpoint.
  • No same-task price-versus-correctness comparison is made between DeepSeek and another model here.

Follow the lab

New test reports and tier-list changes get announced in my Discord's #news channel. The full videos are on YouTube.

Receipts

4 items

DanManREAL · AI lab

Test receipt

Public benchmarkNov 17, 2026

DeepSeek V4.1 Flash

DeepSWE v1.1
74.2%DeepSeek vendor comparison table (model publisher). Original V4.1 Flash, not Flash-1017; Mini-SWE-V2. Not independently rerun by DanManREAL.
Terminal-Bench 4.0
31.2%DeepSeek vendor comparison table (model publisher). Original V4.1 Flash, not Flash-1017; Claude Code harness. Not independently rerun by DanManREAL.
ProgramBench
20.3DeepSeek vendor comparison table (model publisher). Original V4.1 Flash; metric as published. Not independently rerun by DanManREAL.
Source review
November 17, 2026Date these source claims were reviewed; not a claim about when the published benchmark was executed.

Verdict

Published benchmark evidence

Tier list The November 17 tier is Dan’s own ranking; public benchmark numbers are a separate evidence channel, not an automatic tier adjustment.

danmanreal.com/tests/deepseek-v4-1-flash-public-benchmarks

Models covered by external benchmarks

DeepSeek V4.1 Flash

On the tier list's bench

Related

Independent testing. Sponsorships are always disclosed, and verdicts are never for sale.

Disagree? Bring your receipts

All reports

36 reports