Skip to content
Log inStart free trial
Free tool

Is your site technically ready for AI and search crawlers?

A real technical readiness check in about a minute: robots.txt, sitemap, indexability and the crawler policy you publish. When the evidence supports a score we show it; otherwise we show exactly what was and was not measured.

What your result will show

Readiness score
A score out of 100 when enough of the checks completed. Otherwise "Partly checked", with what could and could not be read.
Five sub-scores
Sitemap, robots.txt, indexability, crawlability and AI search crawler policy.
Files and fixes
Whether robots.txt, the sitemap and llms.txt were found, and the top things to fix.
Your result appears on this page and is not emailed to you. We save your email with the request, and our team can see it.

We fetch your robots.txt, sitemap and a sample of pages: a real check, no made-up scores.

  • Limits. Up to 6 runs an hour from one IP address. Repeating the audit for the same website within 24 hours shows the saved result. All visitors share a daily limit. When it is used up, nothing runs and this page says so.
  • Wait. This fetches your robots.txt, sitemap and a sample of pages, so the time depends on how quickly your site answers. Keep this page open: the button says when it is running.

What you get

A real crawl, not a quiz score

We fetch your robots.txt, sitemap and a sample of pages, then score sitemap health, robots.txt, indexability, crawlability and your declared AI search crawler policy.

AI search crawler policy, not assumed access

Which named crawlers your published robots policy allows or blocks, from Googlebot to Claude-SearchBot, split into AI search crawlers, AI training, fetchers a person triggers, ordinary search engines and robots.txt control tokens. Only the AI search crawlers are scored, and this is declared policy, not verified live crawler activity.

The fixes, not just the problems

Severity-ranked issues with a fix each. In the product you also get a copy-paste robots.txt and a generated starter llms.txt.

Technical readiness gets crawlers in the door. Next, generate a starter llms.txt, an optional map of your best content. The product then tracks what five engines actually say about you, and closes the loop from finding a gap to fixing it and tracking what changed.