Free tool · AI search
AI Crawler Checker
Paste your robots.txt and see exactly which AI crawlers you allow, block, or never mentioned.
Nothing is uploaded. Parsing happens in this tab.
Frequently asked questions
Two common ways. A blanket Disallow rule meant for scrapers catches them, or a security plugin or CDN adds bot rules you never saw. The subtler one: naming a user-agent gives it its own group, and it then stops obeying your * rules entirely — so a rule you thought applied to everyone silently does not apply to the bot you named.
More free tools
llms.txt GeneratorBuild the llms.txt file that tells ChatGPT, Perplexity, and Claude which of your pages to cite.llms.txt ValidatorCheck an llms.txt for the mistakes that stop an assistant using it properly.llms.txt from SitemapTurn a sitemap into a first-draft llms.txt, grouped into sections automatically.
Veritas does this continuously across your whole site, not one page at a time.
AI Visibility TrackingSee where you actually stand.
GOOGLE · CHATGPT · PERPLEXITY · GEMINI · AI OVERVIEWS