AI Crawler Access
25 / 100Can AI bots reach and read your pages?
- — HTTPS · robots.txt · sitemap.xml
- — GPTBot · ClaudeBot · PerplexityBot · Google-Extended · CCBot · Amazonbot allow-lists
- — llms.txt / llms-full.txt presence
We score llms.txt, schema.org structured data, AI crawler rules, and citation signals — 24 on-page checks across ChatGPT, Claude, Gemini, and Perplexity. Like Lighthouse. Free, no login.
We break AI-search readiness into the four categories that actually move the needle.
Can AI bots reach and read your pages?
Does JSON-LD make your page meaning machine-readable?
AIs cite pages they can attribute. Is your metadata there?
Is the content structured so AI can summarize and quote it?
Just the page you want to audit. No login needed.
We fetch the page and score it from an AI-search perspective.
0–100 per category with a concrete fix link for every failure.
A real, shareable report — not a black-box score.
crawler.llms-txt-presentNo /llms.txt or /.well-known/llms.txt found on this origin.
Publish an llms.txt at the site root following the llms.txt spec.
Get the same score from your terminal and block regressions on every PR with GitHub Actions.