When stopping our JBoss instance, we often encounter a hang. I did a
Ctrl-break to retrieve the thread information and there is obviously a
deadlock. Attached is the full log of the console output.
The version of log4j used is 1.1.3 according to the manifest contained
in the log4j jar.
I think the problem may lie in JBoss as the deadlock happens when using
the org.jboss.logging.log4j.* classes.
I didn't have a chance to look at the sources yet.
Here's a summary of the output:
[...]
Java stack information for the threads listed above:
===================================================
"Thread-23":
at org.apache.log4j.Category.callAppenders(Category.java:253)
- waiting to lock <0328F228> (a
org.apache.log4j.spi.RootCategory)
at org.apache.log4j.Category.forcedLog(Category.java:445)
at org.apache.log4j.Category.log(Category.java:864)
at
org.jboss.logging.log4j.CategoryStream.write(CategoryStream.java:91)
- locked <0329D410> (a
org.jboss.logging.log4j.CategoryStream) at
org.jboss.logging.log4j.CategoryStream.println(CategoryStream.java:49)
at
org.hsqldb.Embedded_ServerConnection.run(Embedded_ServerConnection.java:161)
at java.lang.Thread.run(Thread.java:536)
"Thread-2":
at java.io.PrintStream.flush(PrintStream.java:133)
- waiting to lock <0329D410> (a
org.jboss.logging.log4j.CategoryStream)
at
sun.nio.cs.StreamEncoder$CharsetSE.implFlush(StreamEncoder.java:408)
at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:150)
- locked <0349E880> (a java.io.OutputStreamWriter)
at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:213)
at
org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:49)
at
org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:309)
at
org.apache.log4j.WriterAppender.append(WriterAppender.java:157)
at
org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
- locked <0349DB48> (a org.apache.log4j.ConsoleAppender)
at
org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57)
at org.apache.log4j.Category.callAppenders(Category.java:255)
- locked <0328F228> (a org.apache.log4j.spi.RootCategory)
at org.apache.log4j.Category.forcedLog(Category.java:445)
[...]
Found 1 deadlock.
Cheers,
Jerome
[INFO,J2eeDeployer] Undeployed 2 applications.
[INFO,STDOUT] 288891 [Thread-2] INFO org.jboss.deployment.J2eeDeployer J2EE Deployer
Default - Undeployed 2 applications
.
[INFO,J2eeDeployer] Stopped
[INFO,STDOUT] 288891 [Thread-2] INFO org.jboss.deployment.J2eeDeployer - Stopped
[INFO,JettyService] Stopping
[INFO,STDOUT] 288891 [Thread-2] INFO org.jboss.jetty.JettyService - Stopping
[INFO,Jetty] Stopping Acceptor ServerSocket[addr=0.0.0.0/0.0.0.0,port=0,localport=8084]
[INFO,STDOUT] 288891 [Acceptor
ServerSocket[addr=0.0.0.0/0.0.0.0,port=0,localport=8084]] INFO org.jboss.jetty.Jetty
- S
topping Acceptor ServerSocket[addr=0.0.0.0/0.0.0.0,port=0,localport=8084]
[INFO,Jetty] Stopped SocketListener on 0.0.0.0:8084
[INFO,STDOUT] 288891 [Thread-2] INFO org.jboss.jetty.Jetty Jetty - Stopped
SocketListener on 0.0.0.0:8084
[INFO,Jetty] Stopped ResourceHandler in ServletHttpContext[/]
[INFO,STDOUT] 288891 [Thread-2] INFO org.jboss.jetty.Jetty Jetty - Stopped
ResourceHandler in ServletHttpContext[/]
[INFO,Jetty] Stopped NotFoundHandler in HttpContext[/]
[INFO,STDOUT] 288891 [Thread-2] INFO org.jboss.jetty.Jetty Jetty - Stopped
NotFoundHandler in HttpContext[/]
[INFO,Jetty] Deregister jboss.web:Jetty=0,HttpContext=0,context=/
[INFO,STDOUT] 288907 [Thread-2] INFO org.jboss.jetty.Jetty Jetty - Deregister
jboss.web:Jetty=0,HttpContext=0,context=/
[INFO,Jetty] Stopped org.mortbay.http.NCSARequestLog@13f7281
[INFO,STDOUT] 288907 [Thread-2] INFO org.jboss.jetty.Jetty Jetty - Stopped
org.mortbay.http.NCSARequestLog@13f7281
[INFO,Jetty] Stopped org.jboss.jetty.Jetty@1be0f0a
[INFO,STDOUT] 288907 [Thread-2] INFO org.jboss.jetty.Jetty Jetty - Stopped
org.jboss.jetty.Jetty@1be0f0a
[INFO,JettyService] Stopped
[INFO,STDOUT] 288907 [Thread-2] INFO org.jboss.jetty.JettyService - Stopped
[INFO,ServerSessionPoolLoader] Stopping
[INFO,STDOUT] 288907 [Thread-2] INFO org.jboss.jms.asf.ServerSessionPoolLoader -
Stopping
[INFO,ServerSessionPoolLoader] pool factory StdJMSPool unbound from java:/StdJMSPool
[INFO,STDOUT] 288907 [Thread-2] INFO org.jboss.jms.asf.ServerSessionPoolLoader
StdJMSPool - pool factory StdJMSPool unbo
und from java:/StdJMSPool
[INFO,ServerSessionPoolLoader] Stopped
[INFO,STDOUT] 288907 [Thread-2] INFO org.jboss.jms.asf.ServerSessionPoolLoader -
Stopped
[INFO,JMSProviderLoader] Stopping
[INFO,STDOUT] 288907 [Thread-2] INFO org.jboss.jms.jndi.JMSProviderLoader - Stopping
[INFO,JMSProviderLoader] unbound adapter DefaultJMSProvider from
java:/DefaultJMSProvider
[INFO,STDOUT] 288907 [Thread-2] INFO org.jboss.jms.jndi.JMSProviderLoader
DefaultJMSProvider - unbound adapter DefaultJM
SProvider from java:/DefaultJMSProvider
[INFO,JMSProviderLoader] Stopped
[INFO,STDOUT] 288907 [Thread-2] INFO org.jboss.jms.jndi.JMSProviderLoader - Stopped
[INFO,NamingAlias] Stopping
[INFO,STDOUT] 288907 [Thread-2] INFO org.jboss.naming.NamingAlias - Stopping
[INFO,NamingAlias] Stopped
[INFO,STDOUT] 288907 [Thread-2] INFO org.jboss.naming.NamingAlias - Stopped
[INFO,NamingAlias] Stopping
[INFO,STDOUT] 288907 [Thread-2] INFO org.jboss.naming.NamingAlias - Stopping
[INFO,NamingAlias] Stopped
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.naming.NamingAlias - Stopped
[INFO,QueueManager#ex] Stopping
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#ex - Stopping
[INFO,QueueManager#ex] Stopped
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#ex - Stopped
[INFO,QueueManager#F] Stopping
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#F - Stopping
[INFO,QueueManager#F] Stopped
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#F - Stopped
[INFO,QueueManager#E] Stopping
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#E - Stopping
[INFO,QueueManager#E] Stopped
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#E - Stopped
[INFO,QueueManager#D] Stopping
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#D - Stopping
[INFO,QueueManager#D] Stopped
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#D - Stopped
[INFO,QueueManager#C] Stopping
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#C - Stopping
[INFO,QueueManager#C] Stopped
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#C - Stopped
[INFO,QueueManager#B] Stopping
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#B - Stopping
[INFO,QueueManager#B] Stopped
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#B - Stopped
[INFO,QueueManager#A] Stopping
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#A - Stopping
[INFO,QueueManager#A] Stopped
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#A - Stopped
[INFO,QueueManager#controlQueue] Stopping
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#controlQueue -
Stopping
[INFO,QueueManager#controlQueue] Stopped
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#controlQueue -
Stopped
[INFO,QueueManager#testQueue] Stopping
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#testQueue -
Stopping
[INFO,QueueManager#testQueue] Stopped
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#testQueue -
Stopped
[INFO,QueueManager#DLQ] Stopping
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#DLQ - Stopping
[INFO,QueueManager#DLQ] Stopped
[INFO,STDOUT] 288922 [Thread-2] INFO org.jboss.mq.server.QueueManager#DLQ - Stopped
[INFO,TopicManager] Stopping
[INFO,STDOUT] 288938 [Thread-2] INFO org.jboss.mq.server.TopicManager - Stopping
[INFO,TopicManager] Stopped
[INFO,STDOUT] 288938 [Thread-2] INFO org.jboss.mq.server.TopicManager - Stopped
[INFO,TopicManager] Stopping
[INFO,STDOUT] 288938 [Thread-2] INFO org.jboss.mq.server.TopicManager - Stopping
[INFO,TopicManager] Stopped
[INFO,STDOUT] 288938 [Thread-2] INFO org.jboss.mq.server.TopicManager - Stopped
[INFO,TopicManager] Stopping
[INFO,STDOUT] 288938 [Thread-2] INFO org.jboss.mq.server.TopicManager - Stopping
[INFO,TopicManager] Stopped
[INFO,STDOUT] 288938 [Thread-2] INFO org.jboss.mq.server.TopicManager - Stopped
[INFO,UILServerILService] Stopping
[INFO,STDOUT] 288938 [Thread-2] INFO org.jboss.mq.il.uil.UILServerILService - Stopping
[INFO,UILServerILService] Stopped
[INFO,STDOUT] 288938 [Thread-2] INFO org.jboss.mq.il.uil.UILServerILService - Stopped
[INFO,OILServerILService] Stopping
[INFO,STDOUT] 288938 [Thread-2] INFO org.jboss.mq.il.oil.OILServerILService - Stopping
[INFO,OILServerILService] Stopped
[INFO,STDOUT] 288938 [Thread-2] INFO org.jboss.mq.il.oil.OILServerILService - Stopped
[INFO,RMIServerILService] Stopping
[INFO,STDOUT] 288938 [Thread-2] INFO org.jboss.mq.il.rmi.RMIServerILService - Stopping
[INFO,RMIServerILService] Stopped
[INFO,STDOUT] 288938 [Thread-2] INFO org.jboss.mq.il.rmi.RMIServerILService - Stopped
[INFO,JVMServerILService] Stopping
[INFO,STDOUT] 288938 [Thread-2] INFO org.jboss.mq.il.jvm.JVMServerILService - Stopping
[INFO,JVMServerILService] Stopped
[INFO,STDOUT] 288954 [Thread-2] INFO org.jboss.mq.il.jvm.JVMServerILService - Stopped
[INFO,PersistenceManager] Stopping
[INFO,STDOUT] 288954 [Thread-2] INFO org.jboss.mq.pm.rollinglogged.PersistenceManager
- Stopping
[INFO,PersistenceManager] Stopped
[INFO,STDOUT] 288954 [Thread-2] INFO org.jboss.mq.pm.rollinglogged.PersistenceManager
- Stopped
[INFO,StateManager] Stopping
[INFO,STDOUT] 288954 [Thread-2] INFO org.jboss.mq.server.StateManager - Stopping
[INFO,StateManager] Stopped
[INFO,STDOUT] 288954 [Thread-2] INFO org.jboss.mq.server.StateManager - Stopped
[INFO,JBossMQService] Stopping
[INFO,STDOUT] 288954 [Thread-2] INFO org.jboss.mq.server.JBossMQService - Stopping
[INFO,JBossMQService] Stopped
[INFO,STDOUT] 288954 [Thread-2] INFO org.jboss.mq.server.JBossMQService - Stopped
[INFO,ContainerFactory] Stopping
[INFO,STDOUT] 288954 [Thread-2] INFO org.jboss.ejb.ContainerFactory - Stopping
[INFO,ContainerFactory] Stopped
[INFO,STDOUT] 288954 [Thread-2] INFO org.jboss.ejb.ContainerFactory - Stopped
[INFO,DefaultDS] Stopping
[INFO,STDOUT] 288954 [Thread-2] INFO org.jboss.jdbc.XADataSourceLoader.DefaultDS -
Stopping
[INFO,DefaultDS] XA Connection pool DefaultDS removed from JNDI
[INFO,STDOUT] 288954 [Thread-2] INFO org.jboss.jdbc.XADataSourceLoader.DefaultDS
DefaultDS - XA Connection pool DefaultD
S removed from JNDI
[INFO,STDOUT] 288954 [Thread-2] DEBUG org.jboss.pool.jdbc.xa.XAPoolDataSource
DefaultDS - Closing DataSource
[INFO,STDOUT] 288954 [Thread-2] DEBUG org.jboss.pool.jdbc.xa.XAPoolDataSource
DefaultDS - Binding to JNDI name null
[INFO,STDOUT] 288954 [Thread-2] DEBUG org.jboss.pool.ObjectPool DefaultDS - Removing
pool: DefaultDS
[INFO,DefaultDS] XA Connection pool DefaultDS shut down
[INFO,STDOUT] 288954 [Thread-2] INFO org.jboss.jdbc.XADataSourceLoader.DefaultDS
DefaultDS - XA Connection pool DefaultD
S shut down
[INFO,DefaultDS] Stopped
[INFO,STDOUT] 288954 [Thread-2] INFO org.jboss.jdbc.XADataSourceLoader.DefaultDS -
Stopped
[INFO,HypersonicDatabase] Stopping
[INFO,STDOUT] 288969 [Thread-2] INFO org.jboss.jdbc.HypersonicDatabase - Stopping
[INFO,HypersonicDatabase] Database closed clean
[INFO,STDOUT] 289016 [Thread-2] INFO org.jboss.jdbc.HypersonicDatabase Hypersonic -
Database closed clean
[INFO,HypersonicDatabase] Stopped
[INFO,STDOUT] 289016 [Thread-2] INFO org.jboss.jdbc.HypersonicDatabase - Stopped
[INFO,JdbcProvider] Stopping
[INFO,STDOUT] 289016 [Thread-2] INFO org.jboss.jdbc.JdbcProvider - Stopping
[INFO,JdbcProvider] Stopped
[INFO,STDOUT] 289016 [Thread-2] INFO org.jboss.jdbc.JdbcProvider - Stopped
[INFO,JaasSecurityManagerService] Stopping
[INFO,STDOUT] 289032 [Thread-2] INFO
org.jboss.security.plugins.JaasSecurityManagerService - Stopping
[INFO,STDOUT] 289032 [Thread-2] DEBUG
org.jboss.security.plugins.JaasSecurityManagerService JaasSecurityManagerService -
Installed JAAS Configuration service=Security:name=DefaultLoginConfig,
config=com.sun.security.auth.login.ConfigFile@1a
85d38
[INFO,JaasSecurityManagerService] Stopped
[INFO,STDOUT] 289032 [Thread-2] INFO
org.jboss.security.plugins.JaasSecurityManagerService - Stopped
[INFO,ClientUserTransactionService] Stopping
[INFO,STDOUT] 289032 [Thread-2] INFO
org.jboss.tm.usertx.server.ClientUserTransactionService - Stopping
[INFO,ClientUserTransactionService] Stopped
[INFO,STDOUT] 289032 [Thread-2] INFO
org.jboss.tm.usertx.server.ClientUserTransactionService - Stopped
[INFO,TransactionManagerService] Stopping
[INFO,STDOUT] 289032 [Thread-2] INFO org.jboss.tm.TransactionManagerService - Stopping
[INFO,TransactionManagerService] Stopped
[INFO,STDOUT] 289032 [Thread-2] INFO org.jboss.tm.TransactionManagerService - Stopped
[INFO,JNDIView] Stopping
[INFO,STDOUT] 289047 [Thread-2] INFO org.jboss.naming.JNDIView - Stopping
[INFO,JNDIView] Stopped
[INFO,STDOUT] 289047 [Thread-2] INFO org.jboss.naming.JNDIView - Stopped
[INFO,NamingService] Stopping
[INFO,STDOUT] 289047 [Thread-2] INFO org.jboss.naming.NamingService - Stopping
[INFO,NamingService] Stopping
[INFO,STDOUT] 289047 [Thread-2] INFO org.jboss.naming.NamingService Naming - Stopping
[INFO,NamingService] Stopped
[INFO,STDOUT] 289047 [Thread-2] INFO org.jboss.naming.NamingService Naming - Stopped
[INFO,NamingService] JNP server stopped
[INFO,STDOUT] 289047 [Thread-2] INFO org.jboss.naming.NamingService Naming - JNP
server stopped
[INFO,NamingService] Stopped
[INFO,STDOUT] 289047 [Thread-2] INFO org.jboss.naming.NamingService - Stopped
[INFO,WebService] Stopping
[INFO,STDOUT] 289047 [Thread-2] INFO org.jboss.web.WebService - Stopping
[INFO,WebService] Stopped
[INFO,STDOUT] 289047 [Thread-2] INFO org.jboss.web.WebService - Stopped
[INFO,ServiceControl] Stopped 50 services
[INFO,STDOUT] 289047 [Thread-2] INFO org.jboss.util.ServiceControl - Stopped 50
services
[INFO,ServiceControl] Destroying 50 MBeans
[INFO,STDOUT] 289047 [Thread-2] INFO org.jboss.util.ServiceControl - Destroying 50
MBeans
[INFO,MailService] Destroying
[INFO,STDOUT] 289047 [Thread-2] INFO org.jboss.mail.MailService - Destroying
[INFO,MailService] Destroyed
[INFO,STDOUT] 289047 [Thread-2] INFO org.jboss.mail.MailService - Destroyed
[INFO,RMIConnectorService] Destroying
[INFO,STDOUT] 289047 [Thread-2] INFO org.jboss.jmx.server.RMIConnectorService -
Destroying
[INFO,RMIConnectorService] Destroyed
[INFO,STDOUT] 289063 [Thread-2] INFO org.jboss.jmx.server.RMIConnectorService -
Destroyed
[INFO,JMXAdaptorService] Destroying
[INFO,STDOUT] 289063 [Thread-2] INFO org.jboss.jmx.server.JMXAdaptorService -
Destroying
[INFO,JMXAdaptorService] Destroyed
[INFO,STDOUT] 289063 [Thread-2] INFO org.jboss.jmx.server.JMXAdaptorService -
Destroyed
[INFO,AutoDeployer] Destroying
[INFO,STDOUT] 289063 [Thread-2] INFO org.jboss.ejb.AutoDeployer - Destroying
[INFO,AutoDeployer] Destroyed
[INFO,STDOUT] 289063 [Thread-2] INFO org.jboss.ejb.AutoDeployer - Destroyed
[INFO,JmsXA] Destroying
[INFO,STDOUT] 289063 [Thread-2] INFO org.jboss.resource.ConnectionFactoryLoader.JmsXA
- Destroying
[INFO,JmsXA] Destroyed
[INFO,STDOUT] 289063 [Thread-2] INFO org.jboss.resource.ConnectionFactoryLoader.JmsXA
- Destroyed
[INFO,MinervaDS] Destroying
[INFO,STDOUT] 289063 [Thread-2] INFO
org.jboss.resource.ConnectionFactoryLoader.MinervaDS - Destroying
[INFO,MinervaDS] Destroyed
[INFO,STDOUT] 289063 [Thread-2] INFO
org.jboss.resource.ConnectionFactoryLoader.MinervaDS - Destroyed
[INFO,MinervaXACMFactory] Destroying
[INFO,STDOUT] 289063 [Thread-2] INFO
org.jboss.resource.ConnectionManagerFactoryLoader.MinervaXACMFactory - Destroying
[INFO,MinervaXACMFactory] Destroyed
[INFO,STDOUT] 289063 [Thread-2] INFO
org.jboss.resource.ConnectionManagerFactoryLoader.MinervaXACMFactory - Destroyed
[INFO,MinervaSharedLocalCMFactory] Destroying
[INFO,STDOUT] 289063 [Thread-2] INFO
org.jboss.resource.ConnectionManagerFactoryLoader.MinervaSharedLocalCMFactory - De
stroying
[INFO,MinervaSharedLocalCMFactory] Destroyed
[INFO,STDOUT] 289063 [Thread-2] INFO
org.jboss.resource.ConnectionManagerFactoryLoader.MinervaSharedLocalCMFactory - De
stroyed
[INFO,MinervaNoTransCMFactory] Destroying
[INFO,STDOUT] 289063 [Thread-2] INFO
org.jboss.resource.ConnectionManagerFactoryLoader.MinervaNoTransCMFactory - Destro
ying
[INFO,MinervaNoTransCMFactory] Destroyed
[INFO,STDOUT] 289063 [Thread-2] INFO
org.jboss.resource.ConnectionManagerFactoryLoader.MinervaNoTransCMFactory - Destro
yed
[INFO,RARDeployer] Destroying
[INFO,STDOUT] 289079 [Thread-2] INFO org.jboss.resource.RARDeployer - Destroying
[WARN,RARDeployer] Unable to recursively delete the temp directory
'D:\dev\JBoss-2.4.7_Jetty-4.0.4\jboss\tmp\deploy\RARD
eployer' - it should be cleaned up when the server is next restarted.
[INFO,STDOUT] 289157 [Thread-2] WARN org.jboss.resource.RARDeployer RARDeployer -
Unable to recursively delete the temp
directory 'D:\dev\JBoss-2.4.7_Jetty-4.0.4\jboss\tmp\deploy\RARDeployer' - it should be
cleaned up when the server is nex
t restarted.
[INFO,RARDeployer] Destroyed
[INFO,STDOUT] 289157 [Thread-2] INFO org.jboss.resource.RARDeployer - Destroyed
[INFO,J2eeDeployer] Destroying
[INFO,STDOUT] 289157 [Thread-2] INFO org.jboss.deployment.J2eeDeployer - Destroying
[INFO,J2eeDeployer] Destroyed
[INFO,STDOUT] 289172 [Thread-2] INFO org.jboss.deployment.J2eeDeployer - Destroyed
[INFO,JettyService] Destroying
[INFO,STDOUT] 289172 [Thread-2] INFO org.jboss.jetty.JettyService - Destroying
[INFO,Jetty] Deregister jboss.web:Jetty=0,SocketListener=0
[INFO,STDOUT] 289172 [Thread-2] INFO org.jboss.jetty.Jetty Jetty - Deregister
jboss.web:Jetty=0,SocketListener=0
[INFO,Jetty] Deregister jboss.web:Jetty=0,NCSARequestLog=0
[INFO,STDOUT] 289172 [Thread-2] INFO org.jboss.jetty.Jetty Jetty - Deregister
jboss.web:Jetty=0,NCSARequestLog=0
[INFO,Jetty] Deregister jboss.web:Jetty=0,ServletHttpContext=0,context=/
[INFO,STDOUT] 289172 [Thread-2] INFO org.jboss.jetty.Jetty Jetty - Deregister
jboss.web:Jetty=0,ServletHttpContext=0,con
text=/
[INFO,Jetty] Deregister jboss.web:Jetty=0,ServletHttpContext=1,context=/
[INFO,STDOUT] 289172 [Thread-2] INFO org.jboss.jetty.Jetty Jetty - Deregister
jboss.web:Jetty=0,ServletHttpContext=1,con
text=/
[INFO,Jetty] Deregister jboss.web:Jetty=0
[INFO,STDOUT] 289172 [Thread-2] INFO org.jboss.jetty.Jetty Jetty - Deregister
jboss.web:Jetty=0
[INFO,Jetty] Deregister jboss.web:Jetty=Debug
[INFO,STDOUT] 289172 [Thread-2] INFO org.jboss.jetty.Jetty Jetty - Deregister
jboss.web:Jetty=Debug
[INFO,Jetty] Deregister jboss.web:Jetty=Log
[INFO,STDOUT] 289172 [Thread-2] INFO org.jboss.jetty.Jetty Jetty - Deregister
jboss.web:Jetty=Log
[INFO,Jetty] Deregister jboss.web:Jetty=Log,sink=0
[INFO,STDOUT] 289172 [Thread-2] INFO org.jboss.jetty.Jetty Jetty - Deregister
jboss.web:Jetty=Log,sink=0
[INFO,JettyService] Destroyed
[INFO,STDOUT] 289172 [Thread-2] INFO org.jboss.jetty.JettyService - Destroyed
[INFO,ServerSessionPoolLoader] Destroying
[INFO,STDOUT] 289172 [Thread-2] INFO org.jboss.jms.asf.ServerSessionPoolLoader -
Destroying
[INFO,ServerSessionPoolLoader] Destroyed
[INFO,STDOUT] 289188 [Thread-2] INFO org.jboss.jms.asf.ServerSessionPoolLoader -
Destroyed
Full thread dump Java HotSpot(TM) Client VM (1.4.1-b21 mixed mode):
"Thread-23" daemon prio=5 tid=0x0084F830 nid=0x1a3 waiting for monitor entry
[cb8f000..cb8fd8c]
at org.apache.log4j.Category.callAppenders(Category.java:253)
- waiting to lock <0328F228> (a org.apache.log4j.spi.RootCategory)
at org.apache.log4j.Category.forcedLog(Category.java:445)
at org.apache.log4j.Category.log(Category.java:864)
at org.jboss.logging.log4j.CategoryStream.write(CategoryStream.java:91)
- locked <0329D410> (a org.jboss.logging.log4j.CategoryStream)
at org.jboss.logging.log4j.CategoryStream.println(CategoryStream.java:49)
at org.hsqldb.Embedded_ServerConnection.run(Embedded_ServerConnection.java:161)
at java.lang.Thread.run(Thread.java:536)
"Thread-2" prio=5 tid=0x00849390 nid=0x1b8 waiting for monitor entry [cb0f000..cb0fd8c]
at java.io.PrintStream.flush(PrintStream.java:133)
- waiting to lock <0329D410> (a org.jboss.logging.log4j.CategoryStream)
at sun.nio.cs.StreamEncoder$CharsetSE.implFlush(StreamEncoder.java:408)
at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:150)
- locked <0349E880> (a java.io.OutputStreamWriter)
at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:213)
at org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:49)
at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:309)
at org.apache.log4j.WriterAppender.append(WriterAppender.java:157)
at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
- locked <0349DB48> (a org.apache.log4j.ConsoleAppender)
at
org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57)
at org.apache.log4j.Category.callAppenders(Category.java:255)
- locked <0328F228> (a org.apache.log4j.spi.RootCategory)
at org.apache.log4j.Category.forcedLog(Category.java:445)
at org.apache.log4j.Category.log(Category.java:864)
at org.jboss.logging.Logger.info(Logger.java:133)
at org.jboss.util.ServiceMBeanSupport.destroy(ServiceMBeanSupport.java:168)
at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at com.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1628)
at com.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1523)
at
org.jboss.configuration.ConfigurationService$ServiceProxy.invoke(ConfigurationService.java:967)
at $Proxy0.destroy(Unknown Source)
at org.jboss.util.ServiceControl.destroy(ServiceControl.java:129)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at com.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1628)
at com.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1523)
at org.jboss.util.Shutdown.shutdownServices(Shutdown.java:103)
at org.jboss.util.Shutdown$2.run(Shutdown.java:63)
"SIGINT handler" daemon prio=10 tid=0x008495F0 nid=0x1ce in Object.wait()
[cacf000..cacfd8c]
at java.lang.Object.wait(Native Method)
- waiting on <032B1930> (a org.jboss.util.Shutdown$2)
at java.lang.Thread.join(Thread.java:1008)
- locked <032B1930> (a org.jboss.util.Shutdown$2)
at java.lang.Thread.join(Thread.java:1061)
at java.lang.Shutdown.runHooks(Shutdown.java:130)
at java.lang.Shutdown.sequence(Shutdown.java:165)
at java.lang.Shutdown.exit(Shutdown.java:210)
- locked <06E107C8> (a java.lang.Class)
at java.lang.Terminator$1.handle(Terminator.java:35)
at sun.misc.Signal$1.run(Signal.java:195)
at java.lang.Thread.run(Thread.java:536)
"DestroyJavaVM" prio=5 tid=0x008128A0 nid=0x1b6 waiting on condition [0..6fad8]
"Rollover" daemon prio=5 tid=0x007E0800 nid=0x1dd waiting on condition
[b97f000..b97fd8c]
at java.lang.Thread.sleep(Native Method)
at
org.mortbay.util.RolloverFileOutputStream$Rollover.run(RolloverFileOutputStream.java:260)
"Thread-10" daemon prio=5 tid=0x007D6590 nid=0x10c waiting for monitor entry
[b8bf000..b8bfd8c]
at org.jboss.logging.log4j.CategoryStream.write(CategoryStream.java:65)
- waiting to lock <0329D410> (a org.jboss.logging.log4j.CategoryStream)
at org.jboss.logging.log4j.CategoryStream.println(CategoryStream.java:49)
at org.hsqldb.Embedded_ServerConnection.run(Embedded_ServerConnection.java:161)
at java.lang.Thread.run(Thread.java:536)
"Minerva ObjectPool GC Thread" daemon prio=5 tid=0x007D6AD0 nid=0xe3 in Object.wait()
[b83f000..b83fd8c]
at java.lang.Object.wait(Native Method)
- waiting on <033C3A38> (a org.jboss.pool.PoolGCThread)
at java.lang.Object.wait(Object.java:426)
at org.jboss.pool.PoolGCThread.waitForPools(PoolGCThread.java:67)
- locked <033C3A38> (a org.jboss.pool.PoolGCThread)
at org.jboss.pool.PoolGCThread.run(PoolGCThread.java:37)
"HypersonicDatabaseRunner" daemon prio=5 tid=0x007D1650 nid=0x171 runnable
[b7bf000..b7bfd8c]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
- locked <033B4FC8> (a java.net.PlainSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:439)
at java.net.ServerSocket.accept(ServerSocket.java:410)
at org.hsqldb.Embedded_Server.run(Embedded_Server.java:179)
at org.hsqldb.Embedded_Server.access$0(Embedded_Server.java:101)
at org.hsqldb.Embedded_Server$1.run(Embedded_Server.java:247)
at java.lang.Thread.run(Thread.java:536)
"Thread-4" daemon prio=5 tid=0x007C99C0 nid=0x154 in Object.wait() [b73f000..b73fd8c]
at java.lang.Object.wait(Native Method)
- waiting on <033B0550> (a org.jboss.web.ThreadPool$Worker)
at java.lang.Object.wait(Object.java:426)
at org.jboss.web.ThreadPool$Worker.run(ThreadPool.java:156)
- locked <033B0550> (a org.jboss.web.ThreadPool$Worker)
"GC Daemon" daemon prio=2 tid=0x007C6610 nid=0x85 in Object.wait() [b6ff000..b6ffd8c]
at java.lang.Object.wait(Native Method)
- waiting on <033AA000> (a sun.misc.GC$LatencyLock)
at sun.misc.GC$Daemon.run(GC.java:100)
- locked <033AA000> (a sun.misc.GC$LatencyLock)
"RMI Reaper" prio=5 tid=0x007C5160 nid=0xb6 in Object.wait() [b6bf000..b6bfd8c]
at java.lang.Object.wait(Native Method)
- waiting on <033AA050> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
- locked <033AA050> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:330)
at java.lang.Thread.run(Thread.java:536)
"Thread-3" daemon prio=5 tid=0x007C5C50 nid=0x1ab in Object.wait() [b67f000..b67fd8c]
at java.lang.Object.wait(Native Method)
- waiting on <033AA0C8> (a java.util.TaskQueue)
at java.lang.Object.wait(Object.java:426)
at java.util.TimerThread.mainLoop(Timer.java:403)
- locked <033AA0C8> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:382)
"RMI TCP Accept-0" daemon prio=5 tid=0x007C4EA0 nid=0x106 runnable [b63f000..b63fd8c]
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
- locked <033AA130> (a java.net.PlainSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:439)
at java.net.ServerSocket.accept(ServerSocket.java:410)
at sun.rmi.transport.tcp.TCPTransport.run(TCPTransport.java:334)
at java.lang.Thread.run(Thread.java:536)
"Thread-1" daemon prio=5 tid=0x00785570 nid=0x1d4 waiting on condition
[b1ff000..b1ffd8c]
at java.lang.Thread.sleep(Native Method)
at org.apache.log4j.helpers.FileWatchdog.run(FileWatchdog.java:95)
"Signal Dispatcher" daemon prio=10 tid=0x0076B2A0 nid=0x17f waiting on condition
[0..af7fd74]
"Finalizer" daemon prio=9 tid=0x00767340 nid=0x1bd in Object.wait() [aebf000..aebfd8c]
at java.lang.Object.wait(Native Method)
- waiting on <03262C78> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
- locked <03262C78> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Reference Handler" daemon prio=10 tid=0x00766010 nid=0x135 in Object.wait()
[ae7f000..ae7fd8c]
at java.lang.Object.wait(Native Method)
- waiting on <03262CE0> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:426)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:113)
- locked <03262CE0> (a java.lang.ref.Reference$Lock)
"VM Thread" prio=5 tid=0x007652E0 nid=0x1d2 runnable
"VM Periodic Task Thread" prio=10 tid=0x0076A2A0 nid=0x16e waiting on condition
"Suspend Checker Thread" prio=10 tid=0x0076A170 nid=0x13f runnable
Found one Java-level deadlock:
=============================
"Thread-23":
waiting to lock monitor 0xc6a30c (object 0x328f228, a
org.apache.log4j.spi.RootCategory),
which is held by "Thread-2"
"Thread-2":
waiting to lock monitor 0xc6a22c (object 0x329d410, a
org.jboss.logging.log4j.CategoryStream),
which is held by "Thread-23"
Java stack information for the threads listed above:
===================================================
"Thread-23":
at org.apache.log4j.Category.callAppenders(Category.java:253)
- waiting to lock <0328F228> (a org.apache.log4j.spi.RootCategory)
at org.apache.log4j.Category.forcedLog(Category.java:445)
at org.apache.log4j.Category.log(Category.java:864)
at org.jboss.logging.log4j.CategoryStream.write(CategoryStream.java:91)
- locked <0329D410> (a org.jboss.logging.log4j.CategoryStream)
at org.jboss.logging.log4j.CategoryStream.println(CategoryStream.java:49)
at org.hsqldb.Embedded_ServerConnection.run(Embedded_ServerConnection.java:161)
at java.lang.Thread.run(Thread.java:536)
"Thread-2":
at java.io.PrintStream.flush(PrintStream.java:133)
- waiting to lock <0329D410> (a org.jboss.logging.log4j.CategoryStream)
at sun.nio.cs.StreamEncoder$CharsetSE.implFlush(StreamEncoder.java:408)
at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:150)
- locked <0349E880> (a java.io.OutputStreamWriter)
at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:213)
at org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:49)
at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:309)
at org.apache.log4j.WriterAppender.append(WriterAppender.java:157)
at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
- locked <0349DB48> (a org.apache.log4j.ConsoleAppender)
at
org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:57)
at org.apache.log4j.Category.callAppenders(Category.java:255)
- locked <0328F228> (a org.apache.log4j.spi.RootCategory)
at org.apache.log4j.Category.forcedLog(Category.java:445)
at org.apache.log4j.Category.log(Category.java:864)
at org.jboss.logging.Logger.info(Logger.java:133)
at org.jboss.util.ServiceMBeanSupport.destroy(ServiceMBeanSupport.java:168)
at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at com.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1628)
at com.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1523)
at
org.jboss.configuration.ConfigurationService$ServiceProxy.invoke(ConfigurationService.java:967)
at $Proxy0.destroy(Unknown Source)
at org.jboss.util.ServiceControl.destroy(ServiceControl.java:129)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at com.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1628)
at com.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1523)
at org.jboss.util.Shutdown.shutdownServices(Shutdown.java:103)
at org.jboss.util.Shutdown$2.run(Shutdown.java:63)
Found 1 deadlock.
