FREE · SEO TOOLS
robots.txt Generator.
Generate crawl directives and an optional sitemap reference.
How to use robots.txt Generator
Enter or choose the required input, adjust the settings, then generate and review the result. Allow crawling and add a sitemap URL.
How it works
Generate crawl directives and an optional sitemap reference. robots.txt controls crawling, not privacy or guaranteed deindexing. Inputs stay on your device. Review the preview or output before using it; refresh the page to clear the current working session.
Example
Allow crawling and add a sitemap URL.
Questions about robots.txt Generator
Is robots.txt Generator free, and do I need an account?
Yes. This tool is free to use in your browser without an account. Processing takes place on your device.
What are the limits and what should I check?
robots.txt controls crawling, not privacy or guaranteed deindexing. Review the result before using it in your work.
Is my input sent to a server?
Your input is processed in your browser and is not uploaded by this tool. Files and pasted text are cleared when the page is refreshed. Normal website requests are still required to load the page and its libraries. Read the privacy explanation.