Rattlesnakes By Mail

Bingbot vs Googlebot

Bingbot and Googlebot compared on 12 documented fields, from 21 claims, last verified 2026-09-15.

How many of the compared fields have the same answer for both crawlers, and how many differ.

Bingbot and Googlebot, fields comparedBingbot and Googlebot, fields compared. Different is the largest with 8 fields, out of 12 fields in total.Same: 4 fieldsSame4Different: 8 fieldsDifferent8
Bingbot and Googlebot, fields compared. Different is the largest with 8 fields, out of 12 fields in total. Source: each vendor's own crawler documentation, quoted and dated on every claim page.
FieldBingbotGooglebotComparison
cites_sourcesyesyessame
follows_noarchiveyesnot documenteddifferent
honours_crawl_delayyesnodifferent
observed_verified_request_ratio_censusnot documented0.991different
opt_out_mechanismyesnot documenteddifferent
publishes_ip_listyesyessame
purpose_documentedyessearchdifferent
reads_llms_txtnot_documentednodifferent
respects_robots_txtyesyessame
separate_search_and_training_tokensnoyesdifferent
user_agent_string_fullMozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html)different
verifiable_by_rdnsyesyessame

Differences

FieldBingbot statementGooglebot statement
follows_noarchiveBingbot excludes noarchive-tagged content from Copilot and Chat answers and from generative AI training data.not documented
honours_crawl_delayMicrosoft states that a crawl-delay directive in robots.txt always takes precedence over Bing Webmaster Tools crawl control settings for Bingbot.Google does not support the robots.txt Crawl-delay directive for Googlebot.
observed_verified_request_ratio_censusnot documentedGooglebot requests to Rattlesnakes By Mail matched Google's published IP ranges on 108 of 109 requests between 2026-09-13T20:00Z and 2026-09-15T09:00Z. Googlebot's first request to Rattlesnakes By Mail in that window was /robots.txt at 2026-09-14T11:53:00Z.
opt_out_mechanismMicrosoft lets publishers block Bingbot content from Copilot answers and AI training using noarchive and nocache tags.not documented
purpose_documentedBingbot serves as Microsoft's standard crawler and handles most of Bing's daily web crawling.Googlebot crawls pages for Google Search, Google Images, Google Video, Google News, and Discover.
reads_llms_txtMicrosoft does not publish whether Bingbot reads llms.txt files.Google Search does not use llms.txt files.
separate_search_and_training_tokensMicrosoft controls Bingbot's use in AI training through meta tags rather than publishing a separate training-specific crawler token.Google separates Search crawling under the Googlebot token from Gemini training under the Google-Extended token.
user_agent_string_fullBingbot sends a user agent string containing bingbot/2.0 and a link to Microsoft's bingbot.htm page.Googlebot sends the user agent string Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html).

Sources