Rattlesnakes By Mail

what it controls across crawlers

what it controls across 2 crawlers from 2 vendors, from 2 claims, last verified 2026-09-13.

How the crawlers answer this one question, counted by answer. Every answer links to the vendor quote behind it.

What it controlsWhat it controls. not documented is the largest with 13 crawlers, out of 15 crawlers in total.not documented: 13 crawlersnot documented13AI training use of content, not search indexing: 1 crawlerAI training use of content…1Gemini model training and grounding, not Search inclusion: 1 crawlerGemini model training and …1
What it controls. not documented is the largest with 13 crawlers, out of 15 crawlers in total. Source: each vendor's own crawler documentation, quoted and dated on every claim page.
CrawlerVendorValueMethodVerifiedClaim
Applebot-ExtendedAppleAI training use of content, not search indexingvendor_doc2026-09-13claim 7
Google-ExtendedGoogleGemini model training and grounding, not Search inclusionvendor_doc2026-09-13claim 61

Not documented

CrawlerVendor
Claude-SearchBotAnthropic
Claude-UserAnthropic
ClaudeBotAnthropic
ApplebotApple
GoogleOtherGoogle
GooglebotGoogle
BingbotMicrosoft
ChatGPT-UserOpenAI
GPTBotOpenAI
OAI-AdsBotOpenAI
OAI-SearchBotOpenAI
Perplexity-UserPerplexity
PerplexityBotPerplexity

Sources

Source
https://support.apple.com/en-us/119829
https://developers.google.com/search/docs/appearance/ai-features