Check any website’s llms.txt file and robots.txt directives to understand how it controls AI crawler and LLM access.
Scanned just now
llms.txt
✗ Missing
🤖 AI Bots
🚫 6 blocked
Overall Rating
F — Poor AI access configuration
Audit Summary
llms.txt file present
Not found or not accessible
AI bot access
6 AI bots blocked
📭
No llms.txt found
This domain has not published an llms.txt file.
AI Bot Directives
Raw robots.txt (AI-related)
User-agent: * Disallow: