AI crawler checker
Check whether nine AI crawlers are allowed to read your site, one line of robots.txt at a time.
We fetch robots.txt and parse it the way each crawler does. A few seconds.
Which crawlers does it check?
GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Perplexity-User, Google-Extended, CCBot and meta-externalagent. Between them they feed ChatGPT, Claude, Perplexity, Gemini's grounding and a large share of open model training data.
If your robots.txt blocks them at the root, nothing else on this site can help you: an engine that is not allowed to fetch a page cannot cite it, no matter how well the page is written.
What counts as blocked?
Only a root-level block — Disallow: / with no matching Allow — counts here. A rule that hides your admin directory or your search results is a legitimate choice and is not scored against you.
A named group always wins over the wildcard group, which is how real crawlers resolve it. So a site with Disallow: / under User-agent: * and Allow: / under User-agent: GPTBot is letting GPTBot in, and this checker will say so.
How do I unblock a crawler?
Remove the Disallow: / line from the group that names it, or add a group that names it with Allow: /. The snippet the checker outputs does the second thing for all nine at once. Deploy robots.txt, then re-run the check — the file is fetched live, so the result reflects what is actually being served.
Updated
One question
Find out what ChatGPT says about you.
Same seven checks, same ten seconds, still no signup.
Free forever. The score is never gated.