Scan any domain to discover its llms.txt file and robots.txt AI directives.
See who’s embracing AI and who’s blocking it.
Capabilities
Everything you need to understand how the web interacts with AI crawlers and language models.
Instantly detect and parse llms.txt files, checking for AI permissions, restrictions, and metadata declarations.
Deep analysis of robots.txt for AI-specific user-agents like GPTBot, Google-Extended, CCBot, and more.
Interactive world map showing llms.txt adoption rates by country and region with real-time data.
Track adoption and blocking trends over time with industry breakdowns, TLD analysis, and bot-specific metrics.
Latest AI access audits from across the web
| Domain | llms.txt | AI Bots | robots.txt | Grade | Scanned |
|---|---|---|---|---|---|
| gopsahome.info | ✗ Not found | 0 blocked | ✓ Allowing | B | 4 months ago |
| googlezip.net | ✗ Not found | 0 blocked | ✓ Allowing | B | 4 months ago |
| googletagservices.com | ✗ Not found | 0 blocked | ✓ Allowing | B | 4 months ago |
| googleapis.cn | ✗ Not found | 0 blocked | ✓ Allowing | B | 4 months ago |
| google.us | ✗ Not found | 0 blocked | ✓ Allowing | B | 4 months ago |
| google.ru | ✗ Not found | 0 blocked | ✓ Allowing | B | 4 months ago |
4 months ago
4 months ago
4 months ago
4 months ago
4 months ago
4 months ago