separate search and training tokens across crawlers
separate search and training tokens across 15 crawlers from 6 vendors, from 15 claims, last verified 2026-09-14.
How the crawlers answer this one question, counted by answer. Every answer links to the vendor quote behind it.
| Crawler | Vendor | Value | Method | Verified | Claim |
|---|---|---|---|---|---|
| Applebot | Apple | partial | vendor_doc | 2026-09-13 | claim 14 |
| Applebot-Extended | Apple | yes | vendor_doc | 2026-09-13 | claim 6 |
| Bingbot | Microsoft | no | vendor_doc | 2026-09-14 | claim 126 |
| ChatGPT-User | OpenAI | not_documented | vendor_doc | 2026-09-13 | claim 24 |
| Claude-SearchBot | Anthropic | yes | vendor_doc | 2026-09-13 | claim 33 |
| Claude-User | Anthropic | not_documented | vendor_doc | 2026-09-13 | claim 43 |
| ClaudeBot | Anthropic | yes | vendor_doc | 2026-09-13 | claim 52 |
| Google-Extended | yes | vendor_doc | 2026-09-13 | claim 60 | |
| Googlebot | yes | vendor_doc | 2026-09-13 | claim 68 | |
| GoogleOther | not_documented | vendor_doc | 2026-09-13 | claim 76 | |
| GPTBot | OpenAI | yes | vendor_doc | 2026-09-13 | claim 83 |
| OAI-AdsBot | OpenAI | not_documented | vendor_doc | 2026-09-13 | claim 91 |
| OAI-SearchBot | OpenAI | yes | vendor_doc | 2026-09-13 | claim 99 |
| Perplexity-User | Perplexity | not_documented | vendor_doc | 2026-09-13 | claim 108 |
| PerplexityBot | Perplexity | not_documented | vendor_doc | 2026-09-13 | claim 117 |
Not documented
Every documented crawler has a claim for this field.