AI Bot Crawl Statistics

Transparency dashboard — geolocus.ai, rolling 30 days.

Updated:

165
Crawls — 7 days
331
Crawls — 30 days
1,000
Crawls — all time
11.8%
AI bot share (30d)

AI Crawlers — Last 30 Days

39 crawls — 4 AI bot types.

Bot Crawls Share Last Seen
GPTBot (OpenAI) AI 26 66.7%
ClaudeBot (Anthropic) AI 10 25.6%
ChatGPT Search (OpenAI) AI 2 5.1%
PerplexityBot AI 1 2.6%
Total AI39100%

Search & Other Crawlers — Last 30 Days

292 crawls — 5 bot types.

Bot Crawls Share Last Seen
crawler SEO/Other 250 85.6%
unknown_bot SEO/Other 38 13.0%
Googlebot Search 2 0.7%
Baiduspider Search 1 0.3%
Bingbot (Microsoft) Search 1 0.3%
Total292100%

Top Crawled Paths — Last 30 Days

Path Crawls Share of Total
/research/whitepapers/whitepaper-5-1 253 76.4%
/ 9 2.7%
/multi-site-survey 8 2.4%
/press 6 1.8%
/case-studies 6 1.8%
/about 6 1.8%
/contact 6 1.8%
/services 5 1.5%
/whitepaper 5 1.5%
/faq 5 1.5%
/privacy 4 1.2%
/press/before-ai-can-understand-your-site-it-must-translate-it 3 0.9%
/methodology 3 0.9%
/crawl-stats 3 0.9%
/audit/brafton-2026-04-27 2 0.6%

Collection method: Every bot request to geolocus.ai is intercepted at the Cloudflare edge by the translation-layer CF Pages Function (functions/[[path]].js). 34 bot user-agent patterns are classified via vendor/aryah-shared/src/bot-classification.ts; matched requests are logged to bot_crawl_logs (Supabase Postgres). Cache-HIT requests are also logged via a direct PostgREST insert from the CF Pages Function so no crawl is silently missed.

Raw counts only. No rounding. This is a transparency dashboard — exact numbers are the point. Cross-check against Cloudflare Analytics at any time.

Dogfood: This page demonstrates GEO Signal 3 in action — bot crawl logging on our own property, measured exactly as we measure client properties.

Reference property: Top10Lists.us/crawl-stats — established property with 3M+ crawls/30d using the same methodology.