Skip to main content
DanManREAL/ AI_LAB
Updated Nov 20, 2026Request a test

Field testTested AIBy Published Tested Updated

Claude Duet ran my channel for a week and caught 269 fake AI crawlers

The report

Field test

Verdict

Found it, fixed it, waited for my yes

In one week of real work, Duet pitched this episode, flagged fake AI crawlers on my site and produced a tested fix: 34 new tests, 583 passing. It stopped before the live site; after my yes it pushed, and the fix was live a minute later.

On the tier list: A one-week field test of one product on my own work, not a coding comparison, so it places no agent on the tier list.

Crawler name claimedVisitsOn the owner's listNot on itOf those, secret-file probes
ClaudeBot116704633
Claude-User3203222
Claude-SearchBot4504529
GPTBot4793822
OAI-SearchBot5565203622
ChatGPT-User61372417
PerplexityBot38102815
Perplexity-User2002014
Total915646269174

What I gave it

Claude Duet is Anthropic's proactive agent, opened as a research preview on October 21, 2026. It sends a morning brief, checks in every few hours and asks before it sends, pays, signs or deletes anything. I set it up like a small team: channels for YouTube, my website, my remote PC and my workshop, plus a daily routine that sends me researched video picks. One of those picks was Claude Duet itself, and that became this episode.

Out of the box, Duet can't see the files on your computer. I connected my own MCP server, DMR_REMOTE, to Claude as a custom connector. From Saturday night to Tuesday afternoon (October 24 to 27) that connection made 2,858 calls into my machine, mostly running commands and reading and writing files.

The fake AI crawlers

AI crawlers like ClaudeBot and GPTBot read sites for AI models and AI search. Their name is just a label sent with each request, so anyone can claim it. Anthropic, OpenAI and Perplexity publish the internet addresses their crawlers really use, which makes the claim checkable.

Duet flagged impostors in my site's security logs, and the week was re-checked against those published lists. 915 visits claimed one of eight AI crawler names; 269 came from addresses the owner doesn't list. 174 of those went looking for secret files such as passwords, config files and database backups. None got a real file. The table above counts visits, not distinct addresses.

The fix, and the one decision that was mine

The change it wrote checks every AI crawler claim against its owner's own list: eight crawlers, six lists, refreshed every six hours. A name with an address that isn't on the list no longer counts as that crawler. It came with 34 new tests covering all eight crawlers, and the full suite passed 583 tests with 14 skipped.

It committed the work at 11:19 AM and then stopped before the live site. After I said yes, it pushed at 12:22 PM, and the live security system restarted with the new check at 12:23. The file running on the server is byte for byte the committed file.

The real AI search traffic

The same week, OpenAI's genuine search crawler (OAI-SearchBot) visited 520 times from addresses on OpenAI's list, and ChatGPT fetched the site 37 times because a user asked it to. Separating those from the fakes is the point of the check: one kind brings readers, the other wears a borrowed badge.

Where Duet stops today

  • It is a research preview on a waitlist for US Pro and Max plans, and it shares your plan's usage limits, background checks included.
  • It checks in every few hours, so something urgent can arrive between checks.
  • Every's review by Dan Shipper reports that scheduled runs can't reach custom connectors. That matches my setup: my routine only starts the work, and the work itself happens in a channel.

Limits of this report

  • The connector log names the claude.ai connection, not the product. That the commit, push and calls came from Duet rests on Duet's own messages in my chats, which stay private.
  • My routine, channels and the yes before deploy are my account from those private chats; they are not shown on this page.
  • Counts cover the security log's seven-day window (October 20 to 27, 2026) and count visits, so one address can appear many times. Fake means not on the owner's published list when it was checked.
  • One product, one week, one site. This is not a comparison with other agents.

Follow the lab

New test reports and tier-list changes get announced in my Discord's #news channel. The full videos are on YouTube.

Receipts

9 items

DanManREAL · AI lab

Test receipt

Field testOct 27, 2026

Claude Opus 5.5

Visits claiming an AI crawler name
9158 crawler names from Anthropic, OpenAI and Perplexity, in my site's security log for one week (Oct 20 to 27)
Fakes: address not on the owner's list
269every Claude-SearchBot and Claude-User visit was one; 46 of 116 ClaudeBot visits
Fakes hunting for secret files
174 · 0 got a real fileevery answer was not found, forbidden, gone or a redirect
The fix: crawlers checked against owner lists
8 crawlers · 6 listseach list refreshed every 6 hours; Anthropic publishes one list for its three crawlers
Tests
34 new · 583 passingfull suite: 583 passed, 14 skipped
Committed, pushed, live (Oct 27, ET)
11:19 · 12:22 · 12:23the file running on the server matches the committed file byte for byte
Real OpenAI search crawler visits
520OAI-SearchBot from addresses on OpenAI's list; ChatGPT also fetched the site 37 times for users
Claude connector calls into my PC
2,858Oct 24, 10:54 PM to Oct 27, 4:16 PM ET; 1,441 on Oct 26
Delivered episode
525.033 s

Verdict

Found it, fixed it, waited for my yes

Tier list A one-week field test of one product on my own work, not a coding comparison, so it places no agent on the tier list.

danmanreal.com/tests/claude-duet-runs-my-channel

What was tested

Claude Duet (research preview, Claude Opus 5.5)DMR_REMOTE as a custom connectordanmanreal.com security system (Cerberus Guard)

On the tier list's bench

Shorts

Related

Independent testing. Sponsorships are always disclosed, and verdicts are never for sale.

Disagree? Bring your receipts

All reports

36 reports