Rattlesnakes By Mail

observed paths fetched across crawlers

observed paths fetched across 1 crawlers from 1 vendors, from 1 claims, last verified 2026-09-15.

How the crawlers answer this one question, counted by answer. Every answer links to the vendor quote behind it.

Observed paths fetchedObserved paths fetched. not documented is the largest with 14 crawlers, out of 15 crawlers in total.not documented: 14 crawlersnot documented14robots_txt_and_home_only: 1 crawlerrobots_txt_and_home_only1
Observed paths fetched. not documented is the largest with 14 crawlers, out of 15 crawlers in total. Source: each vendor's own crawler documentation, quoted and dated on every claim page.
CrawlerVendorValueMethodVerifiedClaim
ApplebotApplerobots_txt_and_home_onlyobserved_here2026-09-15claim 150

Not documented

CrawlerVendor
Claude-SearchBotAnthropic
Claude-UserAnthropic
ClaudeBotAnthropic
Applebot-ExtendedApple
Google-ExtendedGoogle
GoogleOtherGoogle
GooglebotGoogle
BingbotMicrosoft
ChatGPT-UserOpenAI
GPTBotOpenAI
OAI-AdsBotOpenAI
OAI-SearchBotOpenAI
Perplexity-UserPerplexity
PerplexityBotPerplexity

Sources

Source
https://rattlesnakesbymail.com/observed/applebot