X

Join or Sign In

Sign in to add and modify your software

Continue with email

By joining Download.com, you agree to our Terms of Use and acknowledge the data practices in our Privacy Policy.

Robots.txt Editor

By NetPromoter Free to try

Developer's Description

Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which are parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable. By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; keep spiders out of sensitive and private areas of your Web site; track spider visits and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with.

Full Specifications

What's new in version 2.0

General

Release November 7, 2008
Date Added August 1, 2005
Version 2.0

Operating Systems

Operating Systems Windows 2000, Windows 98, Windows Me, Windows, Windows XP, Windows NT
Additional Requirements Windows 98/Me/NT/2000/XP/2003 Server

Popularity

Total Downloads 701
Downloads Last Week 0
Report Software

Related Software

WampServer (64-Bit)

Free
WampServer (64-Bit)

Microsoft Visual C++ 2005 Redistributable

Free
Microsoft Visual C++ 2005 Redistributable

WampServer

Free
WampServer

Apache Tomcat (64 bit)

Free
Apache Tomcat (64 bit)