Robots.txt Generator

Build a correct robots.txt file from plain options — allow, block, crawl-delay and sitemap lines.

100% FREE & Unlimited Use — No Sign-Up, No Spinning Wheels — Your Files Never Leave Your Device

How it works

A robots.txt file sits at the root of your website (yoursite.com/robots.txt) and tells search-engine crawlers which paths they may and may not visit. This generator builds a valid file from plain options: choose who the rules apply to (the user-agent — * means every robot), list the paths to block or allow, and add your sitemap address if you have one.

Two things worth knowing: robots.txt is a request, not a lock — well-behaved crawlers obey it, but it cannot protect private content (use real passwords for that). And blocking a page here stops crawling, which is different from removing it from search results.

Your privacy

This tool runs entirely in your browser, on your own device. Nothing you type or paste here is uploaded to a server, saved, or shared — close the tab and it is gone. That is the standing rule for every tool on Just SEO Tools.