Googlebot
Google crawler, purpose: search.
The Googlebot record on Rattlesnakes By Mail is the full published file on Googlebot, a crawler from Google. Each fact on the Googlebot record is a dated claim with a verbatim quote from Google, a source URL, a verification method and a confidence. Sections run in a fixed order: Identity, Claims, Observations, Changes, Questions, Notes.
Googlebot is Google's crawler. The chart counts the pages it read on this site, day by day.
On a typical day the site logs about 12 requests from Googlebot; the busiest day was 2026-09-21 with 711 requests, 59 times the typical day.
Identity
- vendor
- kind
- crawler
- purpose
- search
- ua_token
Googlebot- robots_token
Googlebot- ip_list_url
- https://developers.google.com/static/crawling/ipranges/common-crawlers.json
- docs_url
- https://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers
- status
- active
Common crawler for Google Search, Discover, Images, Video and News.
Claims
| Field | Value | Method | Confidence |
|---|---|---|---|
| observed_verified_request_ratio_census | 0.991 | observed_here | high |
| cites_sources | yes | vendor_doc | high |
| honours_crawl_delay | no | vendor_doc | medium |
| publishes_ip_list | yes | vendor_doc | high |
| purpose_documented | search | vendor_doc | high |
| reads_llms_txt | no | vendor_doc | high |
| respects_robots_txt | yes | vendor_doc | high |
| separate_search_and_training_tokens | yes | vendor_doc | high |
| user_agent_string_full | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) | vendor_doc | high |
| verifiable_by_rdns | yes | vendor_doc | high |
Observations
- requests, last 30 days
- 1328
- verified requests, last 30 days
- 628
- verified share, last 30 days
- 47%
- daily rows recorded
- 24
Changes
| Date | Claim | Kind | Old value | New value |
|---|---|---|---|---|
| 2026-09-17 | observed_verified_request_ratio_census | new | 0.991 | |
| 2026-09-14 | reads_llms_txt | new | no | |
| 2026-09-13 | respects_robots_txt | new | yes | |
| 2026-09-13 | honours_crawl_delay | new | no | |
| 2026-09-13 | publishes_ip_list | new | yes | |
| 2026-09-13 | verifiable_by_rdns | new | yes | |
| 2026-09-13 | purpose_documented | new | search | |
| 2026-09-13 | separate_search_and_training_tokens | new | yes | |
| 2026-09-13 | cites_sources | new | yes | |
| 2026-09-13 | user_agent_string_full | new | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) |
Notes
No published notes for this entity yet.
Compare with
- Googlebot vs Claude-SearchBot
- Googlebot vs Claude-User
- Googlebot vs ClaudeBot
- Googlebot vs Applebot
- Googlebot vs Applebot-Extended
- Googlebot vs Google-Extended
- Googlebot vs GoogleOther
- Googlebot vs Bingbot
- Googlebot vs ChatGPT-User
- Googlebot vs GPTBot
- Googlebot vs OAI-AdsBot
- Googlebot vs OAI-SearchBot
- Googlebot vs Perplexity-User
- Googlebot vs PerplexityBot
Every claimed field for Googlebot is documented at /fields.
Send a correction by POST to /notes with a target and a body, or use the form on this page. A submitted note stays pending until a reviewer publishes the note, and no submission publishes without review.