Timothy Bish created AMQ-4513:
---------------------------------
Summary: Deadlock can occur on dispose of TempQueue that contains
expired Messages
Key: AMQ-4513
URL: https://issues.apache.org/jira/browse/AMQ-4513
Project: ActiveMQ
Issue Type: Bug
Components: Broker
Affects Versions: 5.8.0, 5.7.0
Reporter: Timothy Bish
Priority: Critical
Fix For: 5.9.0
When a TempQueue is being torn down and it contains expired Messages its
possible for a deadlock occurs if the advisory for expired Message or DLQd
fires at the same time as another Destination is created on the Broker.
{code}
Found one Java-level deadlock:
=============================
"ActiveMQ Transport: tcp:///127.0.0.1:53182@60490":
waiting to lock monitor 0x00007f9630020c80 (object 0x00000007c4541ff0, a
java.util.concurrent.ConcurrentHashMap),
which is held by "ActiveMQ Transport: tcp:///127.0.0.1:53158@60490"
"ActiveMQ Transport: tcp:///127.0.0.1:53158@60490":
waiting for ownable synchronizer 0x00000007c4600f98, (a
java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync),
which is held by "ActiveMQ Transport: tcp:///127.0.0.1:53099@60490"
"ActiveMQ Transport: tcp:///127.0.0.1:53099@60490":
waiting to lock monitor 0x00007f9630020c80 (object 0x00000007c4541ff0, a
java.util.concurrent.ConcurrentHashMap),
which is held by "ActiveMQ Transport: tcp:///127.0.0.1:53158@60490"
Java stack information for the threads listed above:
===================================================
"ActiveMQ Transport: tcp:///127.0.0.1:53182@60490":
at
org.apache.activemq.broker.region.RegionBroker.addDestination(RegionBroker.java:271)
- waiting to lock <0x00000007c4541ff0> (a
java.util.concurrent.ConcurrentHashMap)
at
org.apache.activemq.broker.region.RegionBroker.addDestinationInfo(RegionBroker.java:297)
at
org.apache.activemq.advisory.AdvisoryBroker.addDestinationInfo(AdvisoryBroker.java:189)
at
org.apache.activemq.broker.BrokerFilter.addDestinationInfo(BrokerFilter.java:217)
at
org.apache.activemq.broker.BrokerFilter.addDestinationInfo(BrokerFilter.java:217)
at
org.apache.activemq.broker.MutableBrokerFilter.addDestinationInfo(MutableBrokerFilter.java:223)
at
org.apache.activemq.broker.TransportConnection.processAddDestination(TransportConnection.java:527)
at
org.apache.activemq.command.DestinationInfo.visit(DestinationInfo.java:122)
at
org.apache.activemq.broker.TransportConnection.service(TransportConnection.java:329)
at
org.apache.activemq.broker.TransportConnection$1.onCommand(TransportConnection.java:184)
at
org.apache.activemq.transport.MutexTransport.onCommand(MutexTransport.java:50)
at
org.apache.activemq.transport.WireFormatNegotiator.onCommand(WireFormatNegotiator.java:113)
at
org.apache.activemq.transport.AbstractInactivityMonitor.onCommand(AbstractInactivityMonitor.java:288)
at
org.apache.activemq.transport.TransportSupport.doConsume(TransportSupport.java:83)
at
org.apache.activemq.transport.tcp.TcpTransport.doRun(TcpTransport.java:214)
at
org.apache.activemq.transport.tcp.TcpTransport.run(TcpTransport.java:196)
at java.lang.Thread.run(Thread.java:722)
"ActiveMQ Transport: tcp:///127.0.0.1:53158@60490":
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000007c4600f98> (a
java.util.concurrent.locks.ReentrantReadWriteLock$NonfairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:867)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1197)
at
java.util.concurrent.locks.ReentrantReadWriteLock$WriteLock.lock(ReentrantReadWriteLock.java:945)
at
org.apache.activemq.broker.region.AbstractRegion.addDestination(AbstractRegion.java:128)
at
org.apache.activemq.broker.region.RegionBroker.addDestination(RegionBroker.java:279)
- locked <0x00000007c4541ff0> (a java.util.concurrent.ConcurrentHashMap)
at
org.apache.activemq.broker.region.RegionBroker.addDestinationInfo(RegionBroker.java:297)
at
org.apache.activemq.advisory.AdvisoryBroker.addDestinationInfo(AdvisoryBroker.java:189)
at
org.apache.activemq.broker.BrokerFilter.addDestinationInfo(BrokerFilter.java:217)
at
org.apache.activemq.broker.BrokerFilter.addDestinationInfo(BrokerFilter.java:217)
at
org.apache.activemq.broker.MutableBrokerFilter.addDestinationInfo(MutableBrokerFilter.java:223)
at
org.apache.activemq.broker.TransportConnection.processAddDestination(TransportConnection.java:527)
at
org.apache.activemq.command.DestinationInfo.visit(DestinationInfo.java:122)
at
org.apache.activemq.broker.TransportConnection.service(TransportConnection.java:329)
at
org.apache.activemq.broker.TransportConnection$1.onCommand(TransportConnection.java:184)
at
org.apache.activemq.transport.MutexTransport.onCommand(MutexTransport.java:50)
at
org.apache.activemq.transport.WireFormatNegotiator.onCommand(WireFormatNegotiator.java:113)
at
org.apache.activemq.transport.AbstractInactivityMonitor.onCommand(AbstractInactivityMonitor.java:288)
at
org.apache.activemq.transport.TransportSupport.doConsume(TransportSupport.java:83)
at
org.apache.activemq.transport.tcp.TcpTransport.doRun(TcpTransport.java:214)
at
org.apache.activemq.transport.tcp.TcpTransport.run(TcpTransport.java:196)
at java.lang.Thread.run(Thread.java:722)
"ActiveMQ Transport: tcp:///127.0.0.1:53099@60490":
at
org.apache.activemq.broker.region.RegionBroker.addDestination(RegionBroker.java:271)
- waiting to lock <0x00000007c4541ff0> (a
java.util.concurrent.ConcurrentHashMap)
at
org.apache.activemq.broker.BrokerFilter.addDestination(BrokerFilter.java:145)
at
org.apache.activemq.advisory.AdvisoryBroker.addDestination(AdvisoryBroker.java:174)
at
org.apache.activemq.broker.BrokerFilter.addDestination(BrokerFilter.java:145)
at
org.apache.activemq.broker.BrokerFilter.addDestination(BrokerFilter.java:145)
at
org.apache.activemq.broker.MutableBrokerFilter.addDestination(MutableBrokerFilter.java:151)
at
org.apache.activemq.broker.region.RegionBroker.send(RegionBroker.java:389)
at
org.apache.activemq.broker.jmx.ManagedRegionBroker.send(ManagedRegionBroker.java:282)
at
org.apache.activemq.advisory.AdvisoryBroker.fireAdvisory(AdvisoryBroker.java:550)
at
org.apache.activemq.advisory.AdvisoryBroker.messageExpired(AdvisoryBroker.java:291)
at
org.apache.activemq.broker.BrokerFilter.messageExpired(BrokerFilter.java:257)
at
org.apache.activemq.broker.BrokerFilter.messageExpired(BrokerFilter.java:257)
at
org.apache.activemq.broker.MutableBrokerFilter.messageExpired(MutableBrokerFilter.java:269)
at
org.apache.activemq.broker.region.Queue.messageExpired(Queue.java:1793)
at
org.apache.activemq.broker.region.Queue.messageExpired(Queue.java:1786)
at
org.apache.activemq.broker.region.Queue.doPageInForDispatch(Queue.java:1911)
at org.apache.activemq.broker.region.Queue.doPageIn(Queue.java:1854)
at org.apache.activemq.broker.region.Queue.purge(Queue.java:1244)
at
org.apache.activemq.broker.region.TempQueue.dispose(TempQueue.java:95)
at
org.apache.activemq.broker.region.AbstractTempRegion.dispose(AbstractTempRegion.java:100)
- locked <0x00000007c45a8718> (a
org.apache.activemq.broker.jmx.ManagedTempQueueRegion)
at
org.apache.activemq.broker.region.AbstractRegion.removeDestination(AbstractRegion.java:216)
at
org.apache.activemq.broker.region.TempQueueRegion.removeDestination(TempQueueRegion.java:63)
at
org.apache.activemq.broker.jmx.ManagedTempQueueRegion.removeDestination(ManagedTempQueueRegion.java:63)
at
org.apache.activemq.broker.region.RegionBroker.removeDestination(RegionBroker.java:290)
at
org.apache.activemq.broker.BrokerFilter.removeDestination(BrokerFilter.java:149)
at
org.apache.activemq.advisory.AdvisoryBroker.removeDestination(AdvisoryBroker.java:202)
at
org.apache.activemq.broker.BrokerFilter.removeDestination(BrokerFilter.java:149)
at
org.apache.activemq.broker.BrokerFilter.removeDestination(BrokerFilter.java:149)
at
org.apache.activemq.broker.MutableBrokerFilter.removeDestination(MutableBrokerFilter.java:155)
at
org.apache.activemq.broker.TransportConnection.processRemoveConnection(TransportConnection.java:815)
- locked <0x00000007c46b1168> (a
org.apache.activemq.broker.jmx.ManagedTransportConnection)
at org.apache.activemq.command.RemoveInfo.visit(RemoveInfo.java:72)
at
org.apache.activemq.broker.TransportConnection.service(TransportConnection.java:329)
at
org.apache.activemq.broker.TransportConnection$1.onCommand(TransportConnection.java:184)
at
org.apache.activemq.transport.MutexTransport.onCommand(MutexTransport.java:50)
at
org.apache.activemq.transport.WireFormatNegotiator.onCommand(WireFormatNegotiator.java:113)
at
org.apache.activemq.transport.AbstractInactivityMonitor.onCommand(AbstractInactivityMonitor.java:288)
at
org.apache.activemq.transport.TransportSupport.doConsume(TransportSupport.java:83)
at
org.apache.activemq.transport.tcp.TcpTransport.doRun(TcpTransport.java:214)
at
org.apache.activemq.transport.tcp.TcpTransport.run(TcpTransport.java:196)
at java.lang.Thread.run(Thread.java:722)
Found 1 deadlock.
Heap
PSYoungGen total 56064K, used 53316K [0x00000007c1600000,
0x00000007c8380000, 0x0000000800000000)
eden space 48064K, 96% used
[0x00000007c1600000,0x00000007c43411b0,0x00000007c44f0000)
from space 8000K, 87% used
[0x00000007c44f0000,0x00000007c4bc0000,0x00000007c4cc0000)
to space 8000K, 0% used
[0x00000007c7bb0000,0x00000007c7bb0000,0x00000007c8380000)
ParOldGen total 128256K, used 2922K [0x0000000744200000,
0x000000074bf40000, 0x00000007c1600000)
object space 128256K, 2% used
[0x0000000744200000,0x00000007444daab8,0x000000074bf40000)
PSPermGen total 21248K, used 13151K [0x000000073f000000,
0x00000007404c0000, 0x0000000744200000)
object space 21248K, 61% used
[0x000000073f000000,0x000000073fcd7eb8,0x00000007404c0000)
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
