Free Robots.txt Tester

Test whether Google, Bing and AI crawlers can access any URL on your site, see the exact rule that decides it, and test changes before you upload them.

Free, no sign-up. Tests 16 crawlers using Google's matching rules.