DO NOT REPLY TO THIS EMAIL, BUT PLEASE POST YOUR BUG RELATED COMMENTS THROUGH THE WEB INTERFACE AVAILABLE AT <http://nagoya.apache.org/bugzilla/show_bug.cgi?id=10698>. ANY REPLY MADE TO THIS MESSAGE WILL NOT BE COLLECTED AND INSERTED IN THE BUG DATABASE.
http://nagoya.apache.org/bugzilla/show_bug.cgi?id=10698 Error - jk_tcp_socket_recvfull failed in mod_jk Summary: Error - jk_tcp_socket_recvfull failed in mod_jk Product: Apache httpd-1.3 Version: 1.3.26 Platform: PC OS/Version: Linux Status: NEW Severity: Major Priority: Other Component: Other mods AssignedTo: [email protected] ReportedBy: [EMAIL PROTECTED] Hi, we have a system with two Apache web servers (1.3.26) on Debian Linux (Intel) and one Tomcat 4.0.4 final on Solaris 8 (Sparc). The system is experiencing heavy loads. Daily, Tomcat serves 200 000 - 300 000 requests. We have two frontends because of lot of static content. Tomcat runs on j2se1_4_0_01. We have set maxProcessors in Tomcat Ajp13 connector to 800. >From time to time on our Apaches jk.log we see these messages: [Thu Jul 11 16:18:30 2002] [jk_ajp_common.c (652)]: ajp_connection_tcp_get_message: Error - jk_tcp_socket_recvfull failed [Thu Jul 11 16:18:30 2002] [jk_ajp_common.c (1013)]: Error reading reply [Thu Jul 11 16:18:30 2002] [jk_ajp_common.c (1150)]: In jk_endpoint_t::service, ajp_get_reply failed in send loop 0 [Thu Jul 11 16:18:44 2002] [jk_ajp_common.c (652)]: ajp_connection_tcp_get_message: Error - jk_tcp_socket_recvfull failed [Thu Jul 11 16:18:44 2002] [jk_ajp_common.c (1013)]: Error reading reply [Thu Jul 11 16:18:44 2002] [jk_ajp_common.c (1150)]: In jk_endpoint_t::service, ajp_get_reply failed in send loop 0 [Thu Jul 11 16:19:08 2002] [jk_ajp_common.c (652)]: ajp_connection_tcp_get_message: Error - jk_tcp_socket_recvfull failed [Thu Jul 11 16:19:08 2002] [jk_ajp_common.c (1013)]: Error reading reply [Thu Jul 11 16:19:08 2002] [jk_ajp_common.c (1150)]: In jk_endpoint_t::service, ajp_get_reply failed in send loop 0 Sometimes we see also these errors: [Thu Jul 11 16:19:16 2002] [jk_ajp_common.c (933)]: Error ajp_process_callback - write failed [Thu Jul 11 16:19:51 2002] [jk_ajp_common.c (933)]: Error ajp_process_callback - write failed These errors as a result do not show web pages. Restart of web servers helps a bit, but when we leave the Apaches to run more hours we run out of Tomcat worker threads (the limit is 800). In the thread dump we can see that almost all of 800 Threads have this stack trace: "Ajp13Processor[8090][24]" daemon prio=5 tid=0x327778 nid=0x29 runnable [da481000..da4819c0] at java.net.SocketInputStream.socketRead0(Native Method) at java.net.SocketInputStream.read(SocketInputStream.java:116) at org.apache.ajp.Ajp13.readN(Ajp13.java:429) at org.apache.ajp.Ajp13.receive(Ajp13.java:469) at org.apache.ajp.Ajp13.receiveNextRequest(Ajp13.java:274) at org.apache.ajp.tomcat4.Ajp13Processor.process(Ajp13Processor.java:371) at org.apache.ajp.tomcat4.Ajp13Processor.run(Ajp13Processor.java:495) at java.lang.Thread.run(Thread.java:536) They are all (almost :) waiting for mod_jk to send something, and mod_jk doesn't send anything. These pointed us that the problem might be in mod_jk. There is another problem that we didn't succeed to correlate to the first one, and this is shown in catalina.out log: BAD packet 18516 In: : [EMAIL PROTECTED] 4/21588 48 54 54 50 02 02 00 08 48 54 54 50 2f 31 2e 31 | HTTP....HTTP.1.1 00 00 0f 2f 73 65 72 76 6c 65 74 2f 61 6e 6b 65 | ....servlet.anke 74 61 00 00 0f 32 31 33 2e 31 39 31 2e 31 34 33 | ta...213.191.143 2e 31 33 39 00 ff ff 00 0c 77 77 77 2e 69 73 6b | .139.....www.isk 6f 6e 2e 68 72 00 00 50 00 00 08 a0 01 00 38 69 | on.hr..P...?..8i 6d 61 67 65 2f 67 69 66 2c 20 69 6d 61 67 65 2f | mage.gif..image. 78 2d 78 62 69 74 6d 61 70 2c 20 69 6d 61 67 65 | x.xbitmap..image 2f 6a 70 65 67 2c 20 69 6d 61 67 65 2f 70 6a 70 | .jpeg..image.pjp 65 67 2c 20 2a 2f 2a 00 a0 03 00 0d 67 7a 69 70 | eg......?...gzip 2c 20 64 65 66 6c 61 74 65 00 a0 04 00 05 65 6e | ..deflate.?...en 2d 75 73 00 a0 06 00 0a 4b 65 65 70 2d 41 6c 69 | .us.?...Keep.Ali 76 65 00 a0 0b 00 0c 77 77 77 2e 69 73 6b 6f 6e | ve.?...www.iskon 2e 68 72 00 a0 0d 00 13 68 74 74 70 3a 2f 2f 77 | .hr.?...http...w 77 77 2e 69 73 6b 6f 6e 2e 68 72 00 a0 0e 00 2e | ww.iskon.hr.?... 4d 6f 7a 69 6c 6c 61 2f 34 2e 30 20 28 63 6f 6d | Mozilla.4.0..com 70 61 74 69 62 6c 65 3b 20 4d 53 49 45 20 36 2e | patible..MSIE.6. 30 3b 20 57 69 6e 64 6f 77 73 20 39 38 29 00 a0 | 0..Windows.98..? 08 00 01 30 00 05 00 4a 71 75 65 73 74 69 6f 6e | ...0...Jquestion 69 64 3d 32 30 30 32 30 37 31 30 30 32 34 39 30 | id.2002071002490 31 33 26 6f 70 74 69 6f 6e 69 64 3d 32 30 30 32 | 13.optionid.2002 30 37 31 30 30 32 35 33 30 31 34 26 73 75 62 6d | 07100253014.subm 69 74 2e 78 3d 32 35 26 73 75 62 6d 69 74 2e 79 | it.x.25.submit.y 3d 38 00 ff 00 00 00 00 00 00 00 00 00 00 00 00 | .8.............. 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ................ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 | ................ Does anyone have an idea what to investigate further ? (or how to solve this problems) Thanks, Sasa Skevin [EMAIL PROTECTED] --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
