You can of course produce a report based on only certain hosts or only certain
user agents. The problem is identifying which ones you want.
You can't use the agent string because a lot of them just pretend to be
Netscape or Netscape (compatible). You can use the hostname, but I would think
that maintaining an up-to-date list of hostnames corresponding to known robots
would be very hard.
The only alternative would be trying to spot them automatically, but I don't
know how to do this reliably.
--
Stephen Turner [EMAIL PROTECTED] http://www.statslab.cam.ac.uk/~sret1/
Statistical Laboratory, 16 Mill Lane, Cambridge CB2 1SB, England
"Ad infinitum, if not ad nauseam." (Interviewee, BBC Radio 4)
--------------------------------------------------------------------
This is the analog-help mailing list. To unsubscribe from this
mailing list, send mail to [EMAIL PROTECTED]
with "unsubscribe analog-help" in the main BODY OF THE MESSAGE.
--------------------------------------------------------------------
