Re: [Zope] Non compliant robots

[Graham Chiu]

In article <[EMAIL PROTECTED]>, J. Atwood
<[EMAIL PROTECTED]> writes
>
>I have exactly the same problem (robot hits my site, I get 400 emails of
>errors even with a robots.txt file). I am not sure what the answer is except
>to add something to your error page that would filter out robot errors.

Since mine happens only on certain pages (forms), perhaps I should just
build up a list of bad remote IP addresses ( criteria - generates more
than 5 errors on the same page ), and then redirect those clients to
another non form page with indexing information for my site... sounds
like the basis of a product 

-- 
Regards,  Graham Chiu
gchiucompkarori.co.nz
http://www.compkarori.co.nz/index.php
Powered by Interbase and Zope

___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )

Re: [Zope] Non compliant robots

[J. Atwood]

> What do people do when their sites get traversed by a robot that keeps
> generating Zope errors ( cookies not enabled I guess ) that doesn't
> observe the robots.txt conventions?  ( I get the errors emailed me which
> is annoying :-(  )

Hey Graham, 

I have exactly the same problem (robot hits my site, I get 400 emails of
errors even with a robots.txt file). I am not sure what the answer is except
to add something to your error page that would filter out robot errors.

J


___
Zope maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope-dev )