Check that AI can reach your site at all

A page AI bots cannot reach cannot be cited, however well it reads. Access checks the door before anything else, so you never polish pages nobody can open.

Book a demoRun a free scan

What Access does

  • Check that your domain answers, that robots.txt can be read, and whether sitemap.xml and llms.txt exist.
  • Test whether each AI bot can really open your site, the way that bot does.
  • Separate the bots that write answers from the bots that collect training data.
  • Generate the right robots.txt in one click, and an llms.txt with deployment steps for your CMS.

How it works

01

Run the check

Access requests your site files and tests each AI bot against your domain.

02

Read the cause

Every block comes with what caused it and how to fix it, not just a red mark.

03

Fix the door

Choose which bots to allow, then generate the file and put it live.

A checklist reads your robots.txt. Access knocks on the door.

A rule in a file does not prove a bot gets in: your server can still block what robots.txt allows. That is why Access sends real requests as each bot. It also keeps answer bots apart from training crawlers, because blocking one does not mean the same thing as blocking the other. Bots that write answers decide whether AI can cite you; bots that collect training data do not.

Site files
DomainReachable
robots.txtFound
sitemap.xmlFound
llms.txtMissing

Create it with the llms.txt wizard, with steps for your CMS.

Bots that write answers
ChatGPT-User
PerplexityBot
Bots that collect training data
GPTBot
Google-Extended
robots.txt · generated
User-agent: ChatGPT-User
Allow: /

User-agent: PerplexityBot
Allow: /

User-agent: GPTBot
Disallow: /

User-agent: Google-Extended
Disallow: /
Copy file
Illustration with sample data

Questions

Should I block bots that collect training data?

That is your call, and Access lets you make it per bot. Bots that collect training data do not affect AI answers, so you can turn them off and leave the others open.

Do I need llms.txt?

It gives AI assistants a short map of your site. Access shows whether you have one, and the wizard writes it from your own titles and descriptions, with steps for your CMS.

The rest of Readiness

AI Readiness Score →Know how ready each page is to be quotedAI Preview →See your page the way AI sees itSimulate →See if AI would cite your page before you publish itAll of Readiness →How the parts work together.
AI crawlers and robots.txt: which bots to allow →What is llms.txt? →

See it on your own pages.

Book a demo to see Access on your own site, or run a free scan to see where you stand today.

Book a demoRun a free scan