Freeware & Shareware > Web Development > E-Commerce > Robots.txt free download

Robots.txt 2.0 Free Download

Robots.txt 2.0 at a glance

A handy tool to track spider visits and create Robots.txt instructions

(Version: 2.0, 2.8 MB)

Robots.txt Description

Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions. The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable. By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with

Robots.txt Info

NetPromoterPublisher:

2.0Version:

Win98,WinME,WinNT 4.x,Windows2000,WinXP,Windows2003OS :

2.8 MBFile Size:

$99.9 SharewarePrice:

May 1, 2004Date Added :

Download Robots.txt 2.0

Robots.txt Related Downloads

DBF Manager 1.44 Popular!
Many of us need a piece of software that can handle all the functionality allowing us access DBF databases fast and letting us alter both data structure and the data itself. DBF Manager is innovative software intended to handle databases seamlessly.
Help & Manual 5.0.4
Help & Manual is a stand-alone authoring tool with an integrated WYSIWYG editor. It creates all types of standard help files: * HTML HELP * Winhelp (.hlp) * Browser help * PDF manuals * E-Books (for CD presentations) * Printed user manuals
Catalog Organizer Deluxe 2.9
Complete program that will help PC users create all kinds of catalogs. Constructors, builders, artist, and all craftsmen can catalog their work. Manufacturers can catalog products. Scientists can create catalogs about their findings.
Key Launcher 1.0
Key Launcher creates and manages hot key shortcuts to run commands and start programs. This saves keystrokes and mouse clicks to get to the features and programs you want more quickly.
Internet Secure Tunneling 2.0.0.244
Internet Secure Tunneling can forward otherwise insecure TCP traffic through encrypted SSH Secure Shell tunnel. You can secure for example DATABASE, POP3, SMTP and HTTP connections that would otherwise be insecure.
Ultratron 1.2
The last human is already dead, slain by evil killer robots! As the last remaining humanoid battle robot, you must avenge the human race and destroy the four bots of the Apocalypse. Fast action retro arcade game based on Robotron.
Logo Factory 2.0
The Logo Factory is an easy to use manager for your Win95/98 Startup and Shutdown screens. With it you can easily create, install and manage your Logos. Use your favorite photographs, wallpaper or any .gif, .bmp, .jpg or .jpeg graphic
Fax4Outlook 2.60.0257
Use your regular phone line or internet to send to multiple fax numbers, receive and manage faxes on your PC as easily as e-mail or like in a regular fax machine. Create facsimile messages with cover pages directly from documents and pictures.
Advanced Mail Bomber 10.3
It is a professional e-mail software intended for fast mailing list management. It allows you to organize e-mail subscriptions on your web site and to send information/notifications to a large number of recipients. You can create and manage unlimited
Backup Plus 7.7.1
Backup Plus allows you to easily backup your important data. Features include the ability to backup to just about any device, FTP backups and timed backup operations. This award winning product is all you need to keep your important data safe!