Sorry I forgot to mention that we are using HttpAsyncClient 4.0-beta3. Thanks, Yu
On Apr 10, 2013, at 2:28 AM, Yu Qiao <[email protected]> wrote: > Hi Httpclient-users, > > We are using HttpAsyncClient library to do web crawling. Basically we are > just using the method provided by the sample code > (http://hc.apache.org/httpcomponents-asyncclient-dev/httpasyncclient/examples/org/apache/http/examples/nio/client/AsyncClientHttpExchangeFutureCallback.java), > but has a much larger request size (~9000). > > While our program runs perfectly fine on my laptop (MacOSX 10.8.2, Intel i5), > often times it core dumps on our cluster. Furthermore, even the program > aborted for one time, when we re-started it, it became normal. The JVM log > indicates that it is caused by > org.apache.http.client.protocol.RequestAddCookies.process. We found a > relevant issue at > http://mail-archives.apache.org/mod_mbox/hc-httpclient-users/201208.mbox/%3ccaogo0vag+w8rv54d2dybk1kv3rb0to0evkvs-req_yftk31...@mail.gmail.com%3E, > but there was no solution. Could you help to look into this issue? Also, We > have the core dump file. Do you have a FTP server so we can drop the file? > > Thanks a lot ! > > --------------------------------------------------------- > JVM Log File (only the very beginning): > --------------------------------------------------------- > # > # A fatal error has been detected by the Java Runtime Environment: > # > # SIGSEGV (0xb) at pc=0x00007f284d1d9967, pid=1985, tid=139810931042048 > # > # JRE version: 7.0_17-b02 > # Java VM: Java HotSpot(TM) 64-Bit Server VM (23.7-b01 mixed mode linux-amd64 > compressed oops) > # Problematic frame: > # J > org.apache.http.client.protocol.RequestAddCookies.process(Lorg/apache/http/HttpRequest;Lorg/apache/http/protocol/HttpContext;)V > # > # Failed to write core dump. Core dumps have been disabled. To enable core > dumping, try "ulimit -c unlimited" before starting Java again > # > # If you would like to submit a bug report, please visit: > # http://bugreport.sun.com/bugreport/crash.jsp > # > > -------------------------------------------------- > Java Runtime arguments > ------------------------------------------------- > -Xmx4g > > ---------------------------------------------------- > System Information: > ---------------------------------------------------- > $ uname -a > Linux ip-10-212-71-144 3.2.0-36-virtual #57-Ubuntu SMP Tue Jan 8 22:04:49 UTC > 2013 x86_64 x86_64 x86_64 GNU/Linux > > $ java -version > java version "1.7.0_17" > Java(TM) SE Runtime Environment (build 1.7.0_17-b02) > Java HotSpot(TM) 64-Bit Server VM (build 23.7-b01, mixed mode) > > $ cat /proc/meminfo | head - n 1 > MemTotal: 7629484 kB > > $ cat /proc/cpuinfo > processor : 0 > vendor_id : GenuineIntel > cpu family : 6 > model : 23 > model name : Intel(R) Xeon(R) CPU E5430 @ 2.66GHz > stepping : 10 > microcode : 0xa07 > cpu MHz : 2666.760 > cache size : 6144 KB > fpu : yes > fpu_exception : yes > cpuid level : 13 > wp : yes > flags : fpu tsc msr pae cx8 cmov pat pse36 clflush dts mmx fxsr sse > sse2 ss ht pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl > pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 lahf_lm > dtherm tpr_shadow vnmi flexpriority > bogomips : 5333.52 > clflush size : 64 > cache_alignment : 64 > address sizes : 38 bits physical, 48 bits virtual > power management: > > processor : 1 > vendor_id : GenuineIntel > cpu family : 6 > model : 23 > model name : Intel(R) Xeon(R) CPU E5430 @ 2.66GHz > stepping : 10 > microcode : 0xa07 > cpu MHz : 2666.760 > cache size : 6144 KB > fpu : yes > fpu_exception : yes > cpuid level : 13 > wp : yes > flags : fpu tsc msr pae cx8 cmov pat pse36 clflush dts mmx fxsr sse > sse2 ss ht pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good nopl > pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 lahf_lm > dtherm tpr_shadow vnmi flexpriority > bogomips : 5333.52 > clflush size : 64 > cache_alignment : 64 > address sizes : 38 bits physical, 48 bits virtual > power management: > > > > >
