Stephen:

Thanks! I'll have to pre-process the logs then.

Andre Assaiante
Unix Team Manager
Ticketmaster Online - CitySearch
[EMAIL PROTECTED]
626-660-2630


> -----Original Message-----
> From: Stephen Turner [mailto:[EMAIL PROTECTED]]
> Sent: Thursday, April 29, 1999 8:12 AM
> To: '[EMAIL PROTECTED]'
> Subject: Re: [analog-help] Spider removal
> 
> 
> On Thu, 29 Apr 1999, Andre Assaiante wrote:
> 
> > Folks:
> > 
> > Assuming that all well-behaved spiders request /robots.txt 
> at some point in
> > their session, is there a way to not only remove the single 
> request for this
> > file (FILEEXCLUDE /robots.txt), but remove the whole 
> session or at least
> > remove the host for the day?
> > 
> 
> No.
> 
> Well, I mean, theoretically possible, but analog won't do it. It's a
> fundamental design principle of analog that it processes each line
> independently; in particular, lines can't influence other lines. This
> means that the results will be the same however your logfiles 
> are split
> up, whenever they're rotated, even if they're concatenated in 
> a different
> order.
> 
> -- 
> Stephen Turner    [EMAIL PROTECTED]    
> http://www.statslab.cam.ac.uk/~sret1/
>   Statistical 
> Laboratory, 16 Mill Lane, Cambridge CB2 1SB, England
> 
> --------------------------------------------------------------------
> This is the analog-help mailing list. To unsubscribe from this
> mailing list, send mail to [EMAIL PROTECTED]
> with "unsubscribe analog-help" in the main BODY OF THE MESSAGE.
> --------------------------------------------------------------------
> 
--------------------------------------------------------------------
This is the analog-help mailing list. To unsubscribe from this
mailing list, send mail to [EMAIL PROTECTED]
with "unsubscribe analog-help" in the main BODY OF THE MESSAGE.
--------------------------------------------------------------------

Reply via email to