Re: [Zope] Non compliant robots

2000-06-29 Thread Graham Chiu
In article <[EMAIL PROTECTED]>, J. Atwood <[EMAIL PROTECTED]> writes > >I have exactly the same problem (robot hits my site, I get 400 emails of >errors even with a robots.txt file). I am not sure what the answer is except >to add something to your error page that would filter out robot errors. S

Re: [Zope] Non compliant robots

2000-06-29 Thread J. Atwood
> What do people do when their sites get traversed by a robot that keeps > generating Zope errors ( cookies not enabled I guess ) that doesn't > observe the robots.txt conventions? ( I get the errors emailed me which > is annoying :-( ) Hey Graham, I have exactly the same problem (robot hits

[Zope] Non compliant robots

2000-06-28 Thread Graham Chiu
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 What do people do when their sites get traversed by a robot that keeps generating Zope errors ( cookies not enabled I guess ) that doesn't observe the robots.txt conventions? ( I get the errors emailed me which is annoying :-( ) The one currently