Rattlesnakes By Mail

Claude-SearchBot vs PerplexityBot

Claude-SearchBot and PerplexityBot compared on 9 documented fields, from 18 claims, last verified 2026-09-13.

How many of the compared fields have the same answer for both crawlers, and how many differ.

Claude-SearchBot and PerplexityBot, fields comparedClaude-SearchBot and PerplexityBot, fields compared. Same is the largest with 5 fields, out of 9 fields in total.Same: 5 fieldsSame5Different: 4 fieldsDifferent4
Claude-SearchBot and PerplexityBot, fields compared. Same is the largest with 5 fields, out of 9 fields in total. Source: each vendor's own crawler documentation, quoted and dated on every claim page.
FieldClaude-SearchBotPerplexityBotComparison
cites_sourcesnot_documentedyesdifferent
honours_crawl_delayyesnot_documenteddifferent
publishes_ip_listyesyessame
purpose_documentedsearchsearchsame
reads_llms_txtnot_documentednot_documentedsame
respects_robots_txtyesyessame
separate_search_and_training_tokensyesnot_documenteddifferent
user_agent_string_fullnot_documentedMozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)different
verifiable_by_rdnsnot_documentednot_documentedsame

Differences

FieldClaude-SearchBot statementPerplexityBot statement
cites_sourcesAnthropic does not publish whether Claude search responses cite pages crawled by Claude-SearchBot.Perplexity links to the websites that PerplexityBot surfaces in Perplexity search results.
honours_crawl_delayClaude-SearchBot respects the Crawl-delay directive in robots.txt when crawling domains.Perplexity does not publish whether PerplexityBot honours the robots.txt Crawl-delay directive.
separate_search_and_training_tokensAnthropic separates search and training controls into two robots.txt tokens: Claude-SearchBot for search and ClaudeBot for training.Perplexity does not document a separate training crawler token alongside PerplexityBot.
user_agent_string_fullAnthropic does not publish a full user agent string for Claude-SearchBot.PerplexityBot sends the user agent string Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot).

Sources