Lycos' spider's agent name is Lycos_Spider_(T-Rex)
and its host name is: *.sjc.lycos.com (e.g. sjc-fe4-1.sjc.lycos.com)
A great table that lists most of the majors is available at:
http://searchenginewatch.com/webmasters/spiderchart.html
If you have a robot.txt file on your site you could grep out robot.txt
requests which
would tell you which robots are looking and enable you to remove the
offending
hits.
I love grep :)
charl
>Hi,
>
>My company's being audited this week, and the people checking up on us have
a
>long list of robots to exclude, some of which have spaces in their name.
>
>A quick browse through the analog docs says
>
>BROWEXCLUDE "lycos spider"
>
>could be the best way of excluding them, but it doesn't work. They are
still
>turning up in the reports. Is there a better way? Maybe it should ignore
case?
>
>Ale
>
> --
>Alejandro Fernandez
>Webmaster
>Sift Group plc., 100 Victoria Street, BRISTOL, BS1 6HZ
>tel:+44 117 915 9600 fax:+44 117 915 9630 http://www.sift.co.uk
>------------ "Vertical B2B Communities"
>------------------------------------------------------------------------
>This is the analog-help mailing list. To unsubscribe from this
>mailing list, send mail to [EMAIL PROTECTED]
>with "unsubscribe" in the main BODY OF THE MESSAGE.
>List archived at http://www.mail-archive.com/[email protected]/
>------------------------------------------------------------------------
------------------------------------------------------------------------
This is the analog-help mailing list. To unsubscribe from this
mailing list, send mail to [EMAIL PROTECTED]
with "unsubscribe" in the main BODY OF THE MESSAGE.
List archived at http://www.mail-archive.com/[email protected]/
------------------------------------------------------------------------
