CrawlmouseBot

Hi — if you’re reading this, you probably saw CrawlmouseBot/1.0 in your access logs.

What is it?

Crawlmouse is a free internal-linking grading service. When someone enters a URL on crawlmouse.com, our bot crawls a small portion of that site (up to 500 pages on the free tier) to build a map of internal links.

How we crawl

We respect robots.txt on every request.
Max 8 concurrent requests per host — we stay polite with bounded concurrency, not aggressive bursts.
We back off immediately on 429 (rate-limited) or 503 responses.
User-Agent: CrawlmouseBot/1.0 (+https://crawlmouse.com/bot)
HTTP only, no headless browser, no cookie persistence.

Block us?

Add this to your robots.txt:

User-agent: CrawlmouseBot
Disallow: /

Takedown a report about your site

We don’t generate public reports without explicit domain-ownership verification. If you found one anyway, send the public URL plus a quick description to takedown@crawlmouse.com.