Generator

Robots.txt Generator

Define per-bot rules, disallow paths, and ship a clean robots.txt to your site root.

Rule 1

User-agent

Crawl-delay (sec, optional)

Disallow (one path per line)

Allow (one path per line)

Sitemap URL (optional)

robots.txt

User-agent: *
Disallow:

Sitemap: https://example.com/sitemap.xml

Upload the file to your site root so it's served at /robots.txt.

Save your report

Download a full SEO audit for your page

Enter a page URL and save every recommendation — including the Robots.txt Generator checks — as a file you can keep or share.