Rattlesnakes By Mail

Bingbot vs GoogleOther

Bingbot and GoogleOther compared on 14 documented fields, from 20 claims, last verified 2026-09-15.

How many of the compared fields have the same answer for both crawlers, and how many differ.

Bingbot and GoogleOther, fields comparedBingbot and GoogleOther, fields compared. Different is the largest with 11 fields, out of 14 fields in total.Same: 3 fieldsSame3Different: 11 fieldsDifferent11
Bingbot and GoogleOther, fields compared. Different is the largest with 11 fields, out of 14 fields in total. Source: each vendor's own crawler documentation, quoted and dated on every claim page.
FieldBingbotGoogleOtherComparison
cites_sourcesyesnot documenteddifferent
follows_noarchiveyesnot documenteddifferent
honours_crawl_delayyesnodifferent
observed_fetches_robots_txtnot documentednodifferent
observed_requested_mcp_endpointnot documentedyesdifferent
opt_out_mechanismyesnot documenteddifferent
publishes_ip_listyesyessame
purpose_documentedyesmixeddifferent
reads_llms_txtnot_documentednot documenteddifferent
respects_robots_txtyesyessame
robots_txt_tokennot documentedGoogleOtherdifferent
separate_search_and_training_tokensnonot_documenteddifferent
user_agent_string_fullMozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)not documenteddifferent
verifiable_by_rdnsyesyessame

Differences

FieldBingbot statementGoogleOther statement
cites_sourcesCopilot Search in Bing delivers clearly cited sources alongside generative answers to support publishers and content owners.not documented
follows_noarchiveBingbot excludes noarchive-tagged content from Copilot and Chat answers and from generative AI training data.not documented
honours_crawl_delayMicrosoft states that a crawl-delay directive in robots.txt always takes precedence over Bing Webmaster Tools crawl control settings for Bingbot.Google does not support the robots.txt Crawl-delay directive for GoogleOther.
observed_fetches_robots_txtnot documentedGoogleOther made 93 requests to Rattlesnakes By Mail between 2026-09-13T20:00Z and 2026-09-15T09:00Z and fetched /robots.txt on none of those requests. GoogleOther's first request to Rattlesnakes By Mail was the home page at 2026-09-14T12:03:30Z.
observed_requested_mcp_endpointnot documentedGoogleOther requested the /mcp endpoint of Rattlesnakes By Mail twice between 2026-09-13T20:00Z and 2026-09-15T09:00Z, at 2026-09-14T15:07:30Z and at 2026-09-14T18:27:49Z. Rattlesnakes By Mail returned status 405 to both GoogleOther requests for /mcp.
opt_out_mechanismMicrosoft lets publishers block Bingbot content from Copilot answers and AI training using noarchive and nocache tags.not documented
purpose_documentedBingbot serves as Microsoft's standard crawler and handles most of Bing's daily web crawling.GoogleOther is a generic crawler that Google product teams use to fetch publicly accessible content from sites.
reads_llms_txtMicrosoft does not publish whether Bingbot reads llms.txt files.not documented
robots_txt_tokennot documentedThe robots.txt token for GoogleOther is GoogleOther.
separate_search_and_training_tokensMicrosoft controls Bingbot's use in AI training through meta tags rather than publishing a separate training-specific crawler token.Google does not document whether content fetched by GoogleOther is used for Gemini training.
user_agent_string_fullBingbot sends a user agent string containing bingbot/2.0 and a link to Microsoft's bingbot.htm page.not documented

Sources