Robots.txt Generator
Developer Tools
100% in-browser
Build a robots.txt to control how search engines crawl your site.
How to use the Robots.txt Generator
- 1 Choose to allow or disallow all crawlers, and add any paths to block.
- 2 Optionally add your sitemap URL.
- 3 Copy the generated robots.txt into your site root.
About the Robots.txt Generator
A robots.txt file tells search-engine crawlers which parts of your site they may or may not access. This generator builds a correct file from a few options, including disallowed paths and your sitemap location.
It runs entirely in your browser — just copy the output to your site root.
Frequently asked questions
Where does robots.txt go?
In your site root, reachable at yourdomain.com/robots.txt.
Does disallow guarantee privacy?
No — it asks crawlers not to index a path; it does not block direct access.
Related tools
More from us
