🚀 Scan Domain
🏠 Home 🔍 AI Audit 🌍 Adoption 🚀 Scan Domain
🔍 AI Access Audit

🚀 Scan any domain for AI access policies

Check any website’s llms.txt file and robots.txt directives to understand how it controls AI crawler and LLM access.

Quick try: openai.com nytimes.com stripe.com

Results for openai.com

Scanned just now

F

llms.txt

✗ Missing

🤖 AI Bots

✓ All allowed

Overall Rating

F — Poor AI access configuration

Audit Summary

⚠️

llms.txt file present

Not found or not accessible

✓

AI bot access

All AI bots allowed

📭

No llms.txt found

This domain has not published an llms.txt file.

AI Bot Directives

✓ No AI bots are blocked in robots.txt

Raw robots.txt (AI-related)

User-agent: *
Allow: /
Disallow: /microsoft-for-startups/

Sitemap: https://openai.com/sitemap.xml