Robots.txt Generator
Build a valid robots.txt file for your website in seconds.
About robots.txt
robots.txt tells search engine crawlers which parts of your site they may or may not access. It should be placed at the root of your domain, e.g. example.com/robots.txt.
Advertisement