Site checks
Site check shows whether the AI tools that write answers can open your website and read your pages. It runs on its own.
What you'll get from this page
- See whether AI crawlers can reach your site, and fix anything that blocks them.
- See which of your pages are ready for AI to read and quote.
- Know what these checks can and can't tell you.
Read your checkabout 1 minute
- 1
Open Site checka few seconds
Go to Site check. It checks the brand picked in the sidebar.
- 2
Let it finishabout 1 minute
You don't start it. It runs on its own after every scan, and when you open the page with no fresh result. We read your sitemap, test 16 AI crawlers against your site, and check up to 10 of your pages.
- 3
Fix what failedvaries
Start with What to fix. Use Show the fix to copy the exact change where we can offer one. Then press Check again.
A result stays fresh for 7 days, because robots.txt rarely changes. Press Check again after you change your site to run it right away.
Can AI crawlers reach your site?
The top of Site check answers one question: can the crawlers behind AI answers reach your site? If they're blocked, AI answers can't use your pages as sources.
- AI tools that can read you
- How many of the crawlers behind AI answers (the search and live-user ones) reached your site. Training crawlers don't count against you.
- Pages AI can use well
- How many of the checked pages are ready for AI to read and quote.
- Last checked
- When the check last finished. It checks itself every week.
- What to fix
- Checks that failed or gave a warning, worst first, with the exact change to copy where we can offer one.
- Details
- Open Show every crawler and check for every site check (robots.txt, live bot access, bot vs browser, meta robots, canonical tag, sitemap, llms.txt and response time) and every crawler we tested, with its robots.txt result (Allowed or Blocked) and its live request result (Reached or Blocked).
| Crawler group | What it does |
|---|---|
| Search | Builds the indexes AI answers draw sources from. These matter most. |
| User | Opens a page live when someone asks an AI assistant about it. |
| Training | Collects text to train AI models. Blocking these is a legitimate choice and doesn't block search crawlers. |
- GPTBotOpenAIAllowed
- OAI-SearchBotOpenAIAllowed
- ClaudeBotAnthropicAllowed
- PerplexityBotPerplexityBlocked
- GooglebotGoogleAllowed
Fix: add an Allow rule for PerplexityBot in robots.txt
Page readiness
Your pages, on Site check, shows how easily AI can read each checked page and use it as a source. It fills in with every check, and pages AI already cites, or that answer an AI search, come first.
Each page gets a readiness score: Ready (70 or more), Needs work (40 to 69) or Not ready (under 40). Open a page to see each check and what to change. The 8 checks are:
- Readable text: words in the HTML without running JavaScript. Most AI crawlers don't run it.
- Headings, Structured data, Meta description and Preview tags.
- Dates: published and updated dates, so AI can tell how current a page is.
- Length: we flag pages under 200 words.
- Page structure: tags such as
<main>and<article>.
What these checks can't tell you
Common questions
Do I have to press anything?
No. Site check runs on its own after every scan, and when you open the page with no fresh result. Check again runs it right away.
Can I check a site without an account?
Yes. The free AI crawler check runs without sign-up.
Why only 10 pages?
Each run checks up to 10 pages to keep it quick. We take them from your sitemap, highest priority first. With no sitemap, we check your homepage.
Does a check use one of my scans?
No. Site checks don't count toward your monthly scans.
See also
Was this page helpful?