FREE TOOL

AI Crawler robots.txt Generator

Select which AI bots to block, copy the generated rules, paste into your robots.txt.

← Check if your site is blocking AI crawlers
Choose bots to block
🤖 AI Training Crawlers
Disallow path:
Generated robots.txt Append this to your existing robots.txt file

✅ Verify it's working

After updating your robots.txt, confirm these bots are actually blocked on your live site.

Check your site now →

📊 Monitor AI crawler traffic

See which AI bots are actually visiting, how often, and the estimated bandwidth cost.

Get CrawlGuard →