Indexing
Robots.txt Tester
Load your live robots.txt or paste your own, then check exactly which addresses each crawler is allowed to visit.
Your robots.txt
1 rule group · 1 sitemap reference
Test addresses
Allowed/
Crawling is permitted by "Allow: /" for Googlebot.
Allowed/admin
Crawling is permitted by "Allow: /" for Googlebot.
Allowed/blog/my-post
Crawling is permitted by "Allow: /" for Googlebot.
0 of 3 blocked for Googlebot.
Check your sitemap
Confirm the sitemap listed in your robots.txt actually loads and lists addresses on the right domain.
Save your report
Download a full SEO audit for your page
Enter a page URL and save every recommendation — including the Robots.txt Tester checks — as a file you can keep or share.