Robots.txt Maker Free Download
Shareware: You can try this program, but this version has some limited features or time usage restrictions. You should purchase it in order to remove those limits.
Robots.txt Maker is a Windows application for Webmasters and Website Owners who want to create attention grabbing robots.txt files fast and easy! Robots.txt Maker includes the most popular User Agents that have been proven to index your files and directories. Crawl delay. Allow your Sitemap(s). Allow and Disallow folders and files and more. Built-In FTP Access. Now you can easily notify robots which of your files and directories to include and exclude from indexing. Prevent search engines from indexing your outdated or private files. Do not let anyone become discouraged after clicking on a link from a search engine database that only shows your photos or outdated pages without any way to reach your website. Robots.txt Maker will guide you through how to make a powerful robots.txt file in no time at all.