Scan any domain to discover its llms.txt file and robots.txt AI directives.
See who’s embracing AI and who’s blocking it.
Capabilities
Everything you need to understand how the web interacts with AI crawlers and language models.
Instantly detect and parse llms.txt files, checking for AI permissions, restrictions, and metadata declarations.
Deep analysis of robots.txt for AI-specific user-agents like GPTBot, Google-Extended, CCBot, and more.
Interactive world map showing llms.txt adoption rates by country and region with real-time data.
Track adoption and blocking trends over time with industry breakdowns, TLD analysis, and bot-specific metrics.
Latest AI access audits from across the web
| Domain | llms.txt | AI Bots | robots.txt | Grade | Scanned |
|---|---|---|---|---|---|
| alchemy.com | ✓ Found | 0 blocked | ✓ Allowing | A+ | 11 hours ago |
| gopsahome.info | ✗ Not found | 0 blocked | ✓ Allowing | B | 14 hours ago |
| googlezip.net | ✗ Not found | 0 blocked | ✓ Allowing | B | 14 hours ago |
| googletagservices.com | ✗ Not found | 0 blocked | ✓ Allowing | B | 14 hours ago |
| googleapis.cn | ✗ Not found | 0 blocked | ✓ Allowing | B | 14 hours ago |
| google.us | ✗ Not found | 0 blocked | ✓ Allowing | B | 14 hours ago |
11 hours ago
14 hours ago
14 hours ago
14 hours ago
14 hours ago
14 hours ago