RoboGen ROBOTS.TXT Editor
RoboGen is a visual editor for Robot Exclusion Files. It allows the user to quickly and easily create the ROBOTS.TXT files required to instruct web search engines which parts of a web site are not to be indexed and made searchable by the general web public. RoboGen does this by providing the user a way to log onto his FTP server and then select the documents and directories which are not to be made searchable. RoboGen ROBOTS.TXT Editor is a shareware developed by Rietta Solutions and listed in search engines software.
Version: 1.52 Released: 1/15/2000
Size: 1.49 MB
Platform: Windows 95, 98, ME, XP, Windows 2000
Download Link: Download
Keywords: search engine martijn koster robots.txt robot meta tag robot exclusion