robots.txt Generator

developer

Create a valid robots.txt file for your website easily.

Sitemap URL

Crawl Delay (seconds)

Allow all pages by default

Disallow Rules

Generated robots.txt

User-agent: *
Allow: /
Disallow: /admin