Diez... I agree that there's something wrong with the crawler's request. But it still seems that TG should handle it better in this case.
I've seen the same or a smiliar error from some fairly legitimate (but small) crawlers. I think one of them might have been a wine blog indexer or something. I suspect that most other platforms can deal with the wrong requests better. Thanks for the help On Aug 12, 3:38 am, "Diez B. Roggisch" <[email protected]> wrote: > On Wednesday 12 August 2009 12:33:33 [email protected] wrote: > > > I've installed some of the error handling routines for TG 1.0.8 so I > > get emails for certain server errors. > > > I've attached the email I get for a 406 Error occasionally. > > > What's causing it? > > AFAIX the speedups are part of simplejson. > > The real culprit here is some crawler though - these frequently have bugs in > their HTTP-requests, and that's causing the error. Try banning the bot with > robots.txt > > Diez --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "TurboGears" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/turbogears?hl=en -~----------~----~----~----~------~----~------~--~---
