At 9:48 AM +0400 6/11/01, Arkadiy Tutatchikov wrote: >Hello, >where could i get a free Perl-CGI Robot for my site?
See the links on the Robot Code page on my site: <http://www.searchtools.com/robots/robot-code.html> If you use old code, check to make sure they know about robots.txt, robots meta tags and don't hit other servers too hard. Avi -- _________________________________________________ Complete Guide to Search Engines for Web Sites, Intranets, and Portals: <http://www.searchtools.com> -- This message was sent by the Internet robots and spiders discussion list ([EMAIL PROTECTED]). For list server commands, send "help" in the body of a message to "[EMAIL PROTECTED]".
