I get 404 as a response to GET http://www.alvaro.net/robots.txt so I think you've somehow managed to delete your robots.txt file (or put it in the wrong place) - - I'm sure Teleport Pro would obey the rules if it had found one.
Tom > -----Original Message----- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]On > Behalf Of Alvaro Valino > Sent: 10 July 2001 00:53 > To: robot-list > Subject: [Robots] What is a robot? > > > > Hello. Yesterday I had a problem with my website. > One unique user got 10000 hits with a program > named 'Teleport Pro'. I have a 'robots.txt' file in > my root directory to avoid the access to cgi and > images, but I don't knowif Teleport Pro is a robot. > It would be possible to add an entry to 'robots.txt': > > User-agent: Teleport Pro > Disallow: / > > Thank you, > > Alvaro > > ===== > Visit Alvaro's MegaStore: http://www.alvaro.net > > __________________________________________________ > Do You Yahoo!? > Get personalized email addresses from Yahoo! Mail > http://personal.mail.yahoo.com/ > > -- > This message was sent by the Internet robots and spiders > discussion list ([EMAIL PROTECTED]). For list server > commands, send "help" in the body of a message to > "[EMAIL PROTECTED]". > -- This message was sent by the Internet robots and spiders discussion list ([EMAIL PROTECTED]). For list server commands, send "help" in the body of a message to "[EMAIL PROTECTED]".
