Use our Robots generator tool to generate robots.txt file for your website.
Robots.txt file hides your directories and files that are not supposed to be visible to search engine bots.
/cgi-bin/ and /images/ are two directories usually hidden from the spider bots. you may add as many directories you wish in the file.
Please copy the code below to link back to this tool from your website if you find it interesting.
