1
What it checks
The tester compares page paths against rules for a chosen crawler and confirms whether a referenced sitemap can be reached.
Indexing
Robots.txt Tester
Load your live robots.txt or paste your own, then check exactly which addresses each crawler is allowed to visit.
Your robots.txt
0 rule groups · 0 sitemap references
Test addresses
Add an address above to see the result.
Check your sitemap
Confirm the sitemap listed in your robots.txt actually loads and lists addresses on the right domain.
Quick guide
Understand your result
2
Read the result
Allowed means the selected crawler can request that path. Blocked identifies the matching rule; it does not remove a page already indexed.
3
What to do next
Correct unintended blocks, upload the revised file at your site root, and retest your key pages and sitemap.
Save your report
Download a full SEO audit for your page
Enter a page URL and save every recommendation — including the Robots.txt Tester checks — as a file you can keep or share.