Rattlesnakes By Mail

Bingbot vs ClaudeBot

Bingbot and ClaudeBot compared on 16 documented fields, from 23 claims, last verified 2026-09-15.

How many of the compared fields have the same answer for both crawlers, and how many differ.

Bingbot and ClaudeBot, fields comparedBingbot and ClaudeBot, fields compared. Different is the largest with 13 fields, out of 16 fields in total.Same: 3 fieldsSame3Different: 13 fieldsDifferent13
Bingbot and ClaudeBot, fields compared. Different is the largest with 13 fields, out of 16 fields in total. Source: each vendor's own crawler documentation, quoted and dated on every claim page.
FieldBingbotClaudeBotComparison
anti_circumvention_stancenot documenteddocumenteddifferent
cites_sourcesyesnot documenteddifferent
follows_noarchiveyesnot documenteddifferent
honours_crawl_delayyesyessame
observed_fetches_jsonnot documentedyesdifferent
observed_fetches_markdownnot documentedyesdifferent
observed_first_request_pathnot documented/sitemap.xmldifferent
observed_format_pass_ordernot documentedhtml_json_mddifferent
opt_out_mechanismyesnot documenteddifferent
publishes_ip_listyesyessame
purpose_documentedyestrainingdifferent
reads_llms_txtnot_documentednot documenteddifferent
respects_robots_txtyesyessame
separate_search_and_training_tokensnoyesdifferent
user_agent_string_fullMozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)not_documenteddifferent
verifiable_by_rdnsyesnot_documenteddifferent

Differences

FieldBingbot statementClaudeBot statement
anti_circumvention_stancenot documentedClaudeBot respects anti-circumvention technologies and does not bypass CAPTCHAs on crawled sites.
cites_sourcesCopilot Search in Bing delivers clearly cited sources alongside generative answers to support publishers and content owners.not documented
follows_noarchiveBingbot excludes noarchive-tagged content from Copilot and Chat answers and from generative AI training data.not documented
observed_fetches_jsonnot documentedClaudeBot made 177 JSON requests to Rattlesnakes By Mail between 2026-09-13T20:00Z and 2026-09-15T09:00Z, covering the .json twin of 170 base paths. The .json URLs of Rattlesnakes By Mail appear in no entry of the 171 URL sitemap.
observed_fetches_markdownnot documentedClaudeBot fetched the .md twin of 170 base paths on Rattlesnakes By Mail between 2026-09-13T20:00Z and 2026-09-15T09:00Z, 170 Markdown requests of 542 ClaudeBot requests in that window. The .md URLs of Rattlesnakes By Mail appear in no entry of the 171 URL sitemap.
observed_first_request_pathnot documentedClaudeBot's first request to Rattlesnakes By Mail between 2026-09-13T20:00Z and 2026-09-15T09:00Z was /sitemap.xml at 2026-09-14T19:53:45Z. ClaudeBot fetched /robots.txt on the second request to Rattlesnakes By Mail.
observed_format_pass_ordernot documentedClaudeBot fetched Rattlesnakes By Mail in three format passes between 2026-09-13T20:00Z and 2026-09-15T09:00Z, HTML from 2026-09-14T20:52Z to 2026-09-14T20:57Z, then JSON from 2026-09-14T21:37Z to 2026-09-14T21:56Z, then Markdown from 2026-09-14T21:37Z to 2026-09-14T21:57Z. The same order holds on 170 of 170 base paths that ClaudeBot fetched in all three formats on Rattlesnakes By Mail.
opt_out_mechanismMicrosoft lets publishers block Bingbot content from Copilot answers and AI training using noarchive and nocache tags.not documented
purpose_documentedBingbot serves as Microsoft's standard crawler and handles most of Bing's daily web crawling.ClaudeBot collects web content for training Anthropic generative AI models.
reads_llms_txtMicrosoft does not publish whether Bingbot reads llms.txt files.not documented
separate_search_and_training_tokensMicrosoft controls Bingbot's use in AI training through meta tags rather than publishing a separate training-specific crawler token.Anthropic separates training and search controls into two robots.txt tokens: ClaudeBot for training and Claude-SearchBot for search.
user_agent_string_fullBingbot sends a user agent string containing bingbot/2.0 and a link to Microsoft's bingbot.htm page.Anthropic does not publish a full user agent string for ClaudeBot.
verifiable_by_rdnsMicrosoft verifies Bingbot traffic through reverse DNS lookups that resolve to hostnames ending in search.msn.com.Anthropic does not publish a reverse-DNS verification method for ClaudeBot.

Sources