Hi All

We have an application that has been running for a while with no noticeable problems. However in recent days the HenryTheMiragoRobot(217.154.245.244 & 217.154.245.249) has been causing an internal server error when visiting our site. No other requests from bots or browsers seem to trigger this.

The problem appears to be that when WORequest.formValues() is called in part of our code it returns null rather than an empty NSDictionary as it would normally. The null then trips us over.

Looking at the WORequest.formValues() method code it appears that this can happen when _contentType() is not equal to either "application/x-www-form-urlencoded" or "multipart/form-data".

Is contentType normally set for a simple GET request, I thought this was only set as part of the response? Does this look like a malformed bot or an error by us? Anybody had and recent problems with HenryTheMiragoRobot?

Ideas?

I think I have seen things like this when the request was a HEAD instead of a GET or POST. Check that. IIRC, i just fail those at the Apache level.

Chuck

--

I have quickly grepped the logs and this is what shows...
217.154.245.249 - - [30/Jun/2006:16:08:50 +0100] "GET /robots.txt HTTP/1.1" 200 68 "http://www.miragorobot.com/scripts/mrinfo.asp"; "HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp)" 26433:217.154.245.249 - - [30/Jun/2006:17:15:54 +0100] "GET / HTTP/ 1.1" 500 38 "http://www.miragorobot.com/scripts/mrinfo.asp"; "HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp)" 26434:217.154.245.249 - - [30/Jun/2006:18:33:55 +0100] "GET / HTTP/ 1.1" 500 38 "http://www.miragorobot.com/scripts/mrinfo.asp"; "HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp)" 26438:217.154.245.249 - - [30/Jun/2006:19:41:51 +0100] "GET / HTTP/ 1.1" 500 38 "http://www.miragorobot.com/scripts/mrinfo.asp"; "HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp)" 26441:217.154.245.249 - - [30/Jun/2006:20:28:04 +0100] "GET / HTTP/ 1.1" 500 38 "http://www.miragorobot.com/scripts/mrinfo.asp"; "HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp)"


It seems to get the robots.txt ok as that is served by apache but the home page fails with a "505" from WO. Other robots seem to manage.....

72.30.177.20 - - [29/Jun/2006:23:37:13 +0100] "GET / HTTP/1.0" 200 5692 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http:// help.yahoo.com/help/us/ysearch/slurp)"


Can't find any HEAD requests.

Regards

Giles



_______________________________________________
Do not post admin requests to the list. They will be ignored.
Webobjects-dev mailing list      ([email protected])
Help/Unsubscribe/Update your Subscription:
http://lists.apple.com/mailman/options/webobjects-dev/archive%40mail-archive.com

This email sent to [email protected]

Reply via email to