On Wednesday 12 August 2009 13:06:09 Sam wrote: > Diez... > > I agree that there's something wrong with the crawler's request. But > it still seems that TG should handle it better in this case. > > I've seen the same or a smiliar error from some fairly legitimate (but > small) crawlers. I think one of them might have been a wine blog > indexer or something. I suspect that most other platforms can deal > with the wrong requests better.
While webapps in general certainly should, I doubt that they do. We created a special "sanitize"-middleware that cleans up a request that otherwise caused exceptions, and that is for TG2/Pylons. Maybe that's a road for you as well - try putting up a kind of cherrypy-filter in there. And I actually reported one of these incidents to the crawler in question, and they immediatly reacted & fixed the bug. Diez --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "TurboGears" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/turbogears?hl=en -~----------~----~----~----~------~----~------~--~---
