Can AI bots see your site?
If AI bots can't reach your pages, AI can't read them. One line in robots.txt can block them. Our free checker tells you in about a minute.
Run the free checkerWhat to look atFree
- robots.txt
- Bot visits
- noindex
- Sitemap
Why bots matter
AI tools send bots to read web pages. If your site blocks them, AI may know less about you. Or it may use old facts from other sites.
Two kinds of bots
Some bots collect pages to train AI. GPTBot is one. Others fetch pages to answer a question right now. OAI-SearchBot is one. You can block one kind and still allow the other.
Common ways sites block bots
A Disallow line in robots.txt. A firewall or bot shield that blocks bots it does not know. A noindex tag on the page.
Bots can see you. Now what?
Being seen is not the same as being named. ChatGPT may still name your rivals. Our free check asks ChatGPT what your buyers ask and shows who it names.