Hi all, I'm running Tomcat 6.0.10 with apr/apr-util 1.2.8, tomcat-native 1.1.8, and JDK 1.6.0_01 (6u1), SSL, i686, CentOS 4.5. It seems that every time I shutdown tomcat, the JVM crashes with a segfault, and looking at the dump I'm wondering if it might be apr-related. It also happens on my 64-bit AMD (64-bit JVM and 64-bit compiled libs) machine with CentOS 4.4. Partial tomcat log and crash log from i686 machine is listed below. I would be interested in any opinions on this.
TOMCAT: Jun 6, 2007 10:56:28 AM org.apache.catalina.ha.session.DeltaManager stop INFO: Manager [localhost#/billboardAdmin] expiring sessions upon shutdown Jun 6, 2007 10:56:28 AM org.apache.catalina.ha.session.DeltaManager stop INFO: Manager [localhost#/billboardUser] expiring sessions upon shutdown Jun 6, 2007 10:56:28 AM org.apache.catalina.ha.session.DeltaManager stop INFO: Manager [localhost#/billboard] expiring sessions upon shutdown Jun 6, 2007 10:56:28 AM org.apache.catalina.ha.session.DeltaManager stop INFO: Manager [localhost#/billboardControl] expiring sessions upon shutdown Jun 6, 2007 10:56:28 AM org.apache.catalina.ha.deploy.FarmWarDeployer stop INFO: Cluster FarmWarDeployer stopped. Jun 6, 2007 10:56:28 AM org.apache.coyote.http11.Http11AprProtocol destroy INFO: Stopping Coyote HTTP/1.1 on http-8081 Jun 6, 2007 10:56:28 AM org.apache.coyote.http11.Http11AprProtocol destroy INFO: Stopping Coyote HTTP/1.1 on http-8444 # # An unexpected error has been detected by Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x08311d0e, pid=25496, tid=3085335456 # # Java VM: Java HotSpot(TM) Server VM (1.6.0_01-b06 mixed mode) # Problematic frame: # C 0x08311d0e # # An error report file with more information is saved as /tmp/hs_err_pid25496.log # # If you would like to submit a bug report, please visit: # http://java.sun.com/webapps/bugreport/crash.jsp # CRASH: # # An unexpected error has been detected by Java Runtime Environment: # # SIGSEGV (0xb) at pc=0x08311d0e, pid=25496, tid=3085335456 # # Java VM: Java HotSpot(TM) Server VM (1.6.0_01-b06 mixed mode) # Problematic frame: # C 0x08311d0e # # If you would like to submit a bug report, please visit: # http://java.sun.com/webapps/bugreport/crash.jsp # --------------- T H R E A D --------------- Current thread (0x08058800): JavaThread "main" [_thread_in_native, id=25498] siginfo:si_signo=11, si_errno=0, si_code=128, si_addr=0x00000000 Registers: EAX=0x08311c1e, EBX=0x636ff164, ECX=0x00000000, EDX=0x630000b8 ESP=0xb7e668dc, EBP=0xb7e668f8, ESI=0x0830fcf0, EDI=0x00000000 EIP=0x08311d0e, CR2=0xb7e15100, EFLAGS=0x00010286 Top of Stack: (sp=0xb7e668dc) 0xb7e668dc: 636f512c 08311cf8 b7fcbe27 00000000 0xb7e668ec: 636f50e4 636e61e8 63000040 b7e66918 0xb7e668fc: 636da2cd 0830fcf0 08058800 00000000 0xb7e6690c: b4d8ae7d 632722f8 63000030 b7e66948 0xb7e6691c: 636db049 083b1500 08058800 b7e66958 0xb7e6692c: 636dae15 b7e66930 00000000 082375d0 0xb7e6693c: 636ff164 63272140 00000000 b7e66978 0xb7e6694c: 636f5425 63000030 63272140 636f50d4 Instructions: (pc=0x08311d0e) 0x08311cfe: 00 00 00 00 00 00 b0 1e 31 08 00 60 aa 08 00 90 0x08311d0e: 1f 08 00 00 00 00 00 00 00 00 c0 1c 31 08 ff ff Stack: [0xb7e17000,0xb7e68000), sp=0xb7e668dc, free space=318k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) C 0x08311d0e C [libapr-1.so.0+0x132cd] C [libapr-1.so.0+0x14049] apr_pool_clear+0x3d C [libtcnative-1.so.0.1.8+0xe425] Java_org_apache_tomcat_jni_Socket_close+0x5d j org.apache.tomcat.jni.Socket.close(J)I+0 j org.apache.tomcat.util.net.AprEndpoint.destroy()V+27 j org.apache.coyote.http11.Http11AprProtocol.destroy()V+35 j org.apache.catalina.connector.Connector.stop()V+109 j org.apache.catalina.core.StandardService.stop()V+201 j org.apache.catalina.core.StandardServer.stop()V+65 j org.apache.catalina.startup.Catalina.stop()V+39 j org.apache.catalina.startup.Catalina.start()V+154 v ~StubRoutines::call_stub V [libjvm.so+0x2b55ed] V [libjvm.so+0x43dd98] V [libjvm.so+0x2b5480] V [libjvm.so+0x48569f] V [libjvm.so+0x48809c] V [libjvm.so+0x321588] C [libjava.so+0x15224] Java_sun_reflect_NativeMethodAccessorImpl_invoke0+0x34 j sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;L java/lang/Object;[Ljava/lang/Object;)Ljava/lang/Objec t;+0 j sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lan g/Object;)Ljava/lang/Object;+87 j sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava /lang/Object;)Ljava/lang/Object;+6 j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Lj ava/lang/Object;+161 j org.apache.catalina.startup.Bootstrap.start()V+37 j org.apache.catalina.startup.Bootstrap.main([Ljava/lang/String;)V+125 v ~StubRoutines::call_stub V [libjvm.so+0x2b55ed] V [libjvm.so+0x43dd98] V [libjvm.so+0x2b5480] V [libjvm.so+0x2de8a6] V [libjvm.so+0x2cff4b] C [java+0x1b98] JavaMain+0x2c8 C [libpthread.so.0+0x53cc] Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j org.apache.tomcat.jni.Socket.close(J)I+0 j org.apache.tomcat.util.net.AprEndpoint.destroy()V+27 j org.apache.coyote.http11.Http11AprProtocol.destroy()V+35 j org.apache.catalina.connector.Connector.stop()V+109 j org.apache.catalina.core.StandardService.stop()V+201 j org.apache.catalina.core.StandardServer.stop()V+65 j org.apache.catalina.startup.Catalina.stop()V+39 j org.apache.catalina.startup.Catalina.start()V+154 v ~StubRoutines::call_stub j sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;L java/lang/Object;[Ljava/lang/Object;)Ljava/lang/Objec t;+0 j sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lan g/Object;)Ljava/lang/Object;+87 j sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava /lang/Object;)Ljava/lang/Object;+6 j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Lj ava/lang/Object;+161 j org.apache.catalina.startup.Bootstrap.start()V+37 j org.apache.catalina.startup.Bootstrap.main([Ljava/lang/String;)V+125 v ~StubRoutines::call_stub --------------- P R O C E S S --------------- Java Threads: ( => current thread ) 0x61a71400 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2" daemon [_thread_blocked, id=11839] 0x606cd000 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1" daemon [_thread_blocked, id=11838] 0x61a81000 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0" daemon [_thread_blocked, id=11837] 0x616fac00 JavaThread "Timer-1" daemon [_thread_blocked, id=11836] 0x080c7800 JavaThread "ajp-8010-1" daemon [_thread_blocked, id=11835] 0x60e59800 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#2" daemon [_thread_blocked, id=25569] 0x60e59400 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#1" daemon [_thread_blocked, id=25568] 0x63811c00 JavaThread "com.mchange.v2.async.ThreadPoolAsynchronousRunner$PoolThread-#0" daemon [_thread_blocked, id=25567] 0x63815800 JavaThread "Timer-0" daemon [_thread_blocked, id=25566] 0x08400400 JavaThread "http-8444-7" daemon [_thread_blocked, id=25559] 0x6374d400 JavaThread "ajp-8010-CometPoller-0" daemon [_thread_blocked, id=25558] 0x63508c00 JavaThread "ajp-8010-Poller-0" daemon [_thread_blocked, id=25557] 0x63709800 JavaThread "ajp-8010-Acceptor-0" daemon [_thread_blocked, id=25556] 0x082d8800 JavaThread "http-8444-6" daemon [_thread_blocked, id=25555] 0x082d7400 JavaThread "http-8444-5" daemon [_thread_blocked, id=25554] 0x082dbc00 JavaThread "http-8444-4" daemon [_thread_blocked, id=25553] 0x08964000 JavaThread "http-8444-3" daemon [_thread_blocked, id=25552] 0x083b0000 JavaThread "http-8444-2" daemon [_thread_blocked, id=25551] 0x6351a000 JavaThread "http-8444-CometPoller-0" daemon [_thread_blocked, id=25550] 0x63215000 JavaThread "http-8444-Poller-0" daemon [_thread_blocked, id=25549] 0x08b05c00 JavaThread "http-8444-1" daemon [_thread_blocked, id=25548] 0x63526c00 JavaThread "http-8444-Acceptor-0" daemon [_thread_blocked, id=25547] 0x638f7800 JavaThread "http-8081-Sendfile-0" daemon [_thread_blocked, id=25546] 0x63778800 JavaThread "http-8081-CometPoller-0" daemon [_thread_blocked, id=25545] 0x6374f400 JavaThread "http-8081-Poller-0" daemon [_thread_blocked, id=25544] 0x08b05000 JavaThread "http-8081-1" daemon [_thread_blocked, id=25543] 0x635f3000 JavaThread "http-8081-Acceptor-0" daemon [_thread_blocked, id=25542] 0x63f02400 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=25509] 0x63f00800 JavaThread "CompilerThread1" daemon [_thread_blocked, id=25508] 0x08154000 JavaThread "CompilerThread0" daemon [_thread_blocked, id=25507] 0x08152c00 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=25506] 0x08142c00 JavaThread "Finalizer" daemon [_thread_blocked, id=25505] 0x0813f000 JavaThread "Reference Handler" daemon [_thread_blocked, id=25504] =>0x08058800 JavaThread "main" [_thread_in_native, id=25498] Other Threads: 0x0813c800 VMThread [id=25503] 0x63f04000 WatcherThread [id=25510] VM state:not at safepoint (normal execution) VM Mutex/Monitor currently owned by a thread: None Heap PSYoungGen total 95168K, used 72630K [0xadb00000, 0xb4b40000, 0xb4cc0000) eden space 87872K, 74% used [0xadb00000,0xb1aced70,0xb30d0000) from space 7296K, 99% used [0xb30d0000,0xb37eed90,0xb37f0000) to space 8576K, 0% used [0xb42e0000,0xb42e0000,0xb4b40000) PSOldGen total 33984K, used 20165K [0x74cc0000, 0x76df0000, 0xadb00000) object space 33984K, 59% used [0x74cc0000,0x760714b8,0x76df0000) PSPermGen total 44544K, used 37881K [0x64cc0000, 0x67840000, 0x74cc0000) object space 44544K, 85% used [0x64cc0000,0x671be628,0x67840000) VM Arguments: jvm_args: -Xmx1024m -XX:MaxPermSize=256m -Djava.awt.headless=true -Dsun.awt.font.advancecache=off -DPAYMENTECH_HOME=/uDOit/payme ntech -Dbootfile=server.properties -ea -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -Djava.util.logging.con fig.file=/usr/local/tomcat-6/conf/logging.properties -Djava.endorsed.dirs=/usr/local/tomcat-6/endorsed -Dcatalina.base=/usr/loca l/tomcat-6 -Dcatalina.home=/usr/local/tomcat-6 -Djava.io.tmpdir=/usr/local/tomcat-6/temp java_command: org.apache.catalina.startup.Bootstrap start Launcher Type: SUN_STANDARD Environment Variables: JAVA_HOME=/usr/java/jdk1.6.0 PATH=/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin LD_LIBRARY_PATH=/usr/java/jdk1.6.0_01/jre/lib/i386/server:/usr/java/jdk1 .6.0_01/jre/lib/i386:/usr/java/jdk1.6.0_01/jre/../lib/i3 86:/usr/local/apr/lib SHELL=/bin/bash Signal Handlers: SIGSEGV: [libjvm.so+0x51d3a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 SIGBUS: [libjvm.so+0x51d3a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 SIGFPE: [libjvm.so+0x43d430], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 SIGPIPE: [libjvm.so+0x43d430], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 SIGILL: [libjvm.so+0x43d430], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000 SIGUSR2: [libjvm.so+0x43f440], sa_mask[0]=0x00000000, sa_flags=0x10000004 SIGHUP: [libjvm.so+0x43ee60], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000 SIGQUIT: [libjvm.so+0x43ee60], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 SIGTERM: [libjvm.so+0x43ee60], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004 SIGUSR2: [libjvm.so+0x43f440], sa_mask[0]=0x00000000, sa_flags=0x10000004 --------------- S Y S T E M --------------- OS:CentOS release 4.5 (Final) uname:Linux 2.6.9-34.ELsmp #1 SMP Fri Feb 24 16:54:53 EST 2006 i686 libc:glibc 2.3.4 NPTL 2.3.4 rlimit: STACK 10240k, CORE 0k, NPROC 64509, NOFILE 8192, AS infinity load average:0.51 0.45 0.37 CPU:total 4 family 15, cmov, cx8, fxsr, mmx, sse, sse2, ht Memory: 4k page, physical 4090492k(174332k free), swap 2040244k(2040240k free) vm_info: Java HotSpot(TM) Server VM (1.6.0_01-b06) for linux-x86, built on Mar 14 2007 00:47:53 by "java_re" with gcc 3.2.1-7a ( J2SE release) Thanx, -Tony -- Anthony J. Biacco Senior Systems/Network Administrator Decentrix Inc. 303-899-4000 x303