Features
-
License:
Free to try; $99.90 to buy (Buy it now)
-
Editor's Rating:
Not rated
- Average User Rating:
-
Downloads:
531
- Operating Systems:
Windows Me, Windows XP, Windows 2000, Windows NT, Windows 98
- Additional Requirements:
Windows 98/Me/NT/2000/XP/2003 Server
- Limitations:
No limitations
- Date Added:
August 01, 2005
Publisher's description of Robots.txt Editor
Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which are parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable. By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; keep spiders out of sensitive and private areas of your Web site; track spider visits and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with.
- See more CNET content tagged:
- search engine,
- spider
More popular Web Development Software downloads
- 40,073 downloads 1. No-IP DUC (Dynamic DNS Update Client)
- 5,170 downloads 2. Microsoft FrontPage 2003 SP2
- 3,152 downloads 3. Serif WebPlus
- 2,380 downloads 4. phpDesigner
- 1,919 downloads 5. Abyss Web Server X1
- See all Web Development Software downloads
User reviews
Write your own review Be the first one to review Robots.txt Editor 2.0 and share your experience with the CNET community!
Submit your review
You must be 13 years of age or older to submit personal information to CNET Networks. In compliance with the Children's Online Privacy Protection Act of 1998, CNET Networks does not accept name and e-mail address information from users who are under 13 years of age.
All submitted ratings and written comments become the sole property of CNET Networks, Inc. (CNET) and may be used at CNET Networks' sole discretion. Ratings and written comments are generally posted within two to four business days in batch groups, not in real time. However, CNET Networks reserves the right to remove or refuse to post any submission for any reason. You acknowledge that you, not CNET Networks, are responsible for the contents of your submission.
CNET Networks is not responsible for the content of the publisher's descriptions or user reviews on this site. We encourage you to determine whether this product or your intended use is legal. We do not encourage or condone the use of any software in violation of applicable laws. CNET Download.com does not sell, resell, or license any of the products listed on the site. We cannot be held liable for issues that arise from the download or use of these products.
