On 03/04/2015 09:38 PM, Rob Godfrey wrote:
That's odd... The out of the box config should have a virtualhost. Were
you running a completely fresh install, or were you running with an
existing config/work directory?
It was a completely fresh install and I set QPID_WORK to the new
install directory. Perhaps that wasn't correct anymore?
The management console showed no virtual hosts, theough the 'default'
for the broker was still listed as 'default' in the broker section above
this. I create a virtual host named default and everything worked.
(Whats a virtual host node btw? I seem to need to create one of those
along side my virtual host?)
In terms of authentication, by default PLAIN is no longer enabled over
non-TLS connections.
I can see the logic. The python 0-10 client by default (i.e. without the
cyrus sasl integration installed) only has ANONYMOUS and PLAIN, so was
unable to connect. Next time I'll try ssl.
There *seems* to be something odd happening when trying to consume
messages from a queue. Over 0-10 I only get the messages if I issue a
message-flush. Over 1.0 I sometimes can't get any messages out at all. Not
sure if this is only when queue was created over 0-10. Even for a queue
created through management, I was not getting messages at times after
having sent them and had them accepted (switching back to 0-10 and
flushing, I could see them all as expected). If the receiver is active
before messages are sent (whether through exchanges or direct through
queues), receiving seems to work ok.
Got a deadlock trying to stop the (java) broker, see attached. On
restarting, my virtual host was there but somehow things were corrupted and
could not connect again until I deleted and recreated it.
So, the deadlock actually happened before the close, it occurred when a
flow arrived at the broker at the same time as a message was being sent
from the broker to a consumer... I'll fix that now on trunk (I don't think
that looks like a new issue, but we should fix it anyway). The effect of
the deadlock would be that that queue would no longer be distributing
messages.
I only noticed the deadlock when trying to stop the broker - it just
hangs. I can see on my current process I have two deadlocks (before
shutting down). Probably the same ones, but just in case its of use,
another stackdump attached.
This does indeed sound like part of the problem at least with the
receive. The queue wasn't completely jammed however, as I could get
messages by rerunning the receiver over 0-10 without flushing.
2015-03-05 09:48:58
Full thread dump OpenJDK 64-Bit Server VM (23.7-b01 mixed mode):
"Attach Listener" daemon prio=10 tid=0x00007ff470008800 nid=0x77c0 waiting on
condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"IoReceiver - /127.0.0.1:32929" daemon prio=10 tid=0x00007ff440010800
nid=0x738b runnable [0x00007ff492912000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:150)
at java.net.SocketInputStream.read(SocketInputStream.java:121)
at
org.apache.qpid.transport.network.io.IoReceiver.run(IoReceiver.java:156)
at java.lang.Thread.run(Thread.java:724)
"IoSender - /127.0.0.1:32929" daemon prio=10 tid=0x00007ff44000f000 nid=0x738a
in Object.wait() [0x00007ff492a13000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000078a9f2948> (a java.lang.Object)
at java.lang.Object.wait(Object.java:503)
at org.apache.qpid.transport.network.io.IoSender.run(IoSender.java:279)
- locked <0x000000078a9f2948> (a java.lang.Object)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-21" prio=10 tid=0x00007ff41800a800 nid=0x7367 waiting for
monitor entry [0x00007ff492b13000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
org.apache.qpid.server.protocol.v1_0.ConsumerTarget_1_0.send(ConsumerTarget_1_0.java:224)
- waiting to lock <0x000000078ae98b80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at
org.apache.qpid.server.protocol.v1_0.ConsumerTarget_1_0.send(ConsumerTarget_1_0.java:120)
at
org.apache.qpid.server.queue.QueueConsumerImpl.send(QueueConsumerImpl.java:469)
at
org.apache.qpid.server.queue.AbstractQueue.deliverMessage(AbstractQueue.java:1323)
at
org.apache.qpid.server.queue.AbstractQueue.attemptDelivery(AbstractQueue.java:2069)
at
org.apache.qpid.server.queue.AbstractQueue.processQueue(AbstractQueue.java:2237)
at org.apache.qpid.server.queue.QueueRunner$1.run(QueueRunner.java:77)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at org.apache.qpid.server.queue.QueueRunner.run(QueueRunner.java:68)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-20" prio=10 tid=0x00007ff418009800 nid=0x7366 waiting on
condition [0x00007ff492c15000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"IoReceiver - /127.0.0.1:32922" daemon prio=10 tid=0x00007ff44000c800
nid=0x7365 waiting on condition [0x00007ff493cfa000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078b97a658> (a
java.util.concurrent.locks.ReentrantLock$NonfairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:867)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1197)
at
java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:214)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:290)
at
org.apache.qpid.server.consumer.AbstractConsumerTarget.getSendLock(AbstractConsumerTarget.java:131)
at
org.apache.qpid.server.queue.QueueConsumerImpl.getSendLock(QueueConsumerImpl.java:423)
at
org.apache.qpid.server.queue.AbstractQueue.flushConsumer(AbstractQueue.java:1978)
at
org.apache.qpid.server.queue.AbstractQueue.flushConsumer(AbstractQueue.java:1957)
at
org.apache.qpid.server.queue.QueueConsumerImpl.flush(QueueConsumerImpl.java:318)
at
org.apache.qpid.server.protocol.v1_0.ConsumerTarget_1_0.flush(ConsumerTarget_1_0.java:354)
at
org.apache.qpid.server.protocol.v1_0.SendingLink_1_0.flowStateChanged(SendingLink_1_0.java:499)
at
org.apache.qpid.server.protocol.v1_0.Session_1_0$SubjectSpecificSendingLinkListener$1.run(Session_1_0.java:822)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at
org.apache.qpid.server.protocol.v1_0.Session_1_0$SubjectSpecificSendingLinkListener.flowStateChanged(Session_1_0.java:817)
at
org.apache.qpid.amqp_1_0.transport.SendingLinkEndpoint.receiveFlow(SendingLinkEndpoint.java:165)
at
org.apache.qpid.amqp_1_0.transport.SessionEndpoint.receiveFlow(SessionEndpoint.java:471)
- locked <0x000000078ae98b80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint.receiveFlow(ConnectionEndpoint.java:671)
- locked <0x000000078ae98b80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at org.apache.qpid.amqp_1_0.type.transport.Flow.invoke(Flow.java:288)
at
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint.receive(ConnectionEndpoint.java:803)
- locked <0x000000078ae98b80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at
org.apache.qpid.amqp_1_0.framing.FrameHandler.parse(FrameHandler.java:241)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL$4.run(ProtocolEngine_1_0_0_SASL.java:384)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL$4.run(ProtocolEngine_1_0_0_SASL.java:380)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL.received(ProtocolEngine_1_0_0_SASL.java:379)
- locked <0x000000078b8e61c0> (a
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL.received(ProtocolEngine_1_0_0_SASL.java:66)
at
org.apache.qpid.server.protocol.MultiVersionProtocolEngine.received(MultiVersionProtocolEngine.java:153)
at
org.apache.qpid.server.protocol.MultiVersionProtocolEngine.received(MultiVersionProtocolEngine.java:51)
at
org.apache.qpid.transport.network.io.IoReceiver.run(IoReceiver.java:161)
at java.lang.Thread.run(Thread.java:724)
"IoSender - /127.0.0.1:32922" daemon prio=10 tid=0x00007ff44000b000 nid=0x7364
in Object.wait() [0x00007ff4982f9000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000078b979690> (a java.lang.Object)
at java.lang.Object.wait(Object.java:503)
at org.apache.qpid.transport.network.io.IoSender.run(IoSender.java:279)
- locked <0x000000078b979690> (a java.lang.Object)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-19" prio=10 tid=0x00007ff414094800 nid=0x7360 waiting on
condition [0x00007ff492dec000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-18" prio=10 tid=0x00007ff41410b000 nid=0x735f waiting on
condition [0x00007ff492eed000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-17" prio=10 tid=0x00007ff414109800 nid=0x735e waiting on
condition [0x00007ff492fee000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-16" prio=10 tid=0x00007ff414108800 nid=0x735d waiting on
condition [0x00007ff4930ef000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-15" prio=10 tid=0x00007ff414107800 nid=0x735c waiting on
condition [0x00007ff498b01000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-14" prio=10 tid=0x00007ff434047800 nid=0x7357 waiting for
monitor entry [0x00007ff4931ef000]
java.lang.Thread.State: BLOCKED (on object monitor)
at
org.apache.qpid.server.protocol.v1_0.ConsumerTarget_1_0.allocateCredit(ConsumerTarget_1_0.java:299)
- waiting to lock <0x000000078b060f80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at
org.apache.qpid.server.queue.QueueConsumerImpl.wouldSuspend(QueueConsumerImpl.java:278)
at
org.apache.qpid.server.queue.AbstractQueue.attemptDelivery(AbstractQueue.java:2059)
at
org.apache.qpid.server.queue.AbstractQueue.processQueue(AbstractQueue.java:2237)
at org.apache.qpid.server.queue.QueueRunner$1.run(QueueRunner.java:77)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at org.apache.qpid.server.queue.QueueRunner.run(QueueRunner.java:68)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-13" prio=10 tid=0x00007ff434001000 nid=0x7356 waiting on
condition [0x00007ff4932f1000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"IoReceiver - /127.0.0.1:32918" daemon prio=10 tid=0x00007ff440009000
nid=0x7355 waiting on condition [0x00007ff4937f5000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078b693670> (a
java.util.concurrent.locks.ReentrantLock$NonfairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:867)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1197)
at
java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:214)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:290)
at
org.apache.qpid.server.consumer.AbstractConsumerTarget.getSendLock(AbstractConsumerTarget.java:131)
at
org.apache.qpid.server.queue.QueueConsumerImpl.getSendLock(QueueConsumerImpl.java:423)
at
org.apache.qpid.server.queue.AbstractQueue.flushConsumer(AbstractQueue.java:1978)
at
org.apache.qpid.server.queue.AbstractQueue.flushConsumer(AbstractQueue.java:1957)
at
org.apache.qpid.server.queue.QueueConsumerImpl.flush(QueueConsumerImpl.java:318)
at
org.apache.qpid.server.protocol.v1_0.ConsumerTarget_1_0.flush(ConsumerTarget_1_0.java:354)
at
org.apache.qpid.server.protocol.v1_0.SendingLink_1_0.flowStateChanged(SendingLink_1_0.java:499)
at
org.apache.qpid.server.protocol.v1_0.Session_1_0$SubjectSpecificSendingLinkListener$1.run(Session_1_0.java:822)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at
org.apache.qpid.server.protocol.v1_0.Session_1_0$SubjectSpecificSendingLinkListener.flowStateChanged(Session_1_0.java:817)
at
org.apache.qpid.amqp_1_0.transport.SendingLinkEndpoint.receiveFlow(SendingLinkEndpoint.java:165)
at
org.apache.qpid.amqp_1_0.transport.SessionEndpoint.receiveFlow(SessionEndpoint.java:471)
- locked <0x000000078b060f80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint.receiveFlow(ConnectionEndpoint.java:671)
- locked <0x000000078b060f80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at org.apache.qpid.amqp_1_0.type.transport.Flow.invoke(Flow.java:288)
at
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint.receive(ConnectionEndpoint.java:803)
- locked <0x000000078b060f80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at
org.apache.qpid.amqp_1_0.framing.FrameHandler.parse(FrameHandler.java:241)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL$4.run(ProtocolEngine_1_0_0_SASL.java:384)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL$4.run(ProtocolEngine_1_0_0_SASL.java:380)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL.received(ProtocolEngine_1_0_0_SASL.java:379)
- locked <0x000000078b056bd0> (a
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL.received(ProtocolEngine_1_0_0_SASL.java:66)
at
org.apache.qpid.server.protocol.MultiVersionProtocolEngine.received(MultiVersionProtocolEngine.java:153)
at
org.apache.qpid.server.protocol.MultiVersionProtocolEngine.received(MultiVersionProtocolEngine.java:51)
at
org.apache.qpid.transport.network.io.IoReceiver.run(IoReceiver.java:161)
at java.lang.Thread.run(Thread.java:724)
"IoSender - /127.0.0.1:32918" daemon prio=10 tid=0x00007ff44000e000 nid=0x7354
in Object.wait() [0x00007ff4936f5000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000078b0a5310> (a java.lang.Object)
at java.lang.Object.wait(Object.java:503)
at org.apache.qpid.transport.network.io.IoSender.run(IoSender.java:279)
- locked <0x000000078b0a5310> (a java.lang.Object)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-12" prio=10 tid=0x00007ff430047800 nid=0x7350 waiting on
condition [0x00007ff4933f2000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-11" prio=10 tid=0x00007ff430046000 nid=0x734f waiting on
condition [0x00007ff4934f3000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-10" prio=10 tid=0x00007ff430001800 nid=0x734e waiting on
condition [0x00007ff4935f4000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-9" prio=10 tid=0x00007ff418007800 nid=0x7348 waiting on
condition [0x00007ff4938f7000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-8" prio=10 tid=0x00007ff418006800 nid=0x7347 waiting on
condition [0x00007ff498a00000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-7" prio=10 tid=0x00007ff418005800 nid=0x7346 waiting on
condition [0x00007ff493ffe000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-6" prio=10 tid=0x00007ff41402a000 nid=0x7345 waiting on
condition [0x00007ff4939f8000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-5" prio=10 tid=0x00007ff414025800 nid=0x7344 waiting on
condition [0x00007ff493af9000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-4" prio=10 tid=0x00007ff414023800 nid=0x7343 waiting on
condition [0x00007ff493bfa000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-3" prio=10 tid=0x00007ff414023000 nid=0x733d waiting on
condition [0x00007ff493dfc000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-2" prio=10 tid=0x00007ff414021000 nid=0x7331 waiting on
condition [0x00007ff493efd000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-3-thread-1" prio=10 tid=0x00007ff414020000 nid=0x7330 waiting on
condition [0x00007ff4981f8000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078af02e88> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"pool-2-thread-1" prio=10 tid=0x00007ff448053800 nid=0x7322 waiting on
condition [0x00007ff4984fb000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078aec2190> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"HttpManagement-31" prio=10 tid=0x00007ff43c018000 nid=0x72f6 waiting on
condition [0x00007ff4983fa000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078ab6a720> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at
java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:724)
"HttpManagement-30" prio=10 tid=0x00007ff43c017000 nid=0x72f5 waiting on
condition [0x00007ff499107000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078ab6a720> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at
java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:724)
"DestroyJavaVM" prio=10 tid=0x00007ff4a400a800 nid=0x72a3 waiting on condition
[0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"GC Daemon" daemon prio=10 tid=0x00007ff4a45ca800 nid=0x72cf in Object.wait()
[0x00007ff4985fc000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000078ac123b0> (a sun.misc.GC$LatencyLock)
at sun.misc.GC$Daemon.run(GC.java:117)
- locked <0x000000078ac123b0> (a sun.misc.GC$LatencyLock)
"RMI Reaper" prio=10 tid=0x00007ff4a45c8800 nid=0x72ce in Object.wait()
[0x00007ff4986fd000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000078ac02af8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
- locked <0x000000078ac02af8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
at sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:351)
at java.lang.Thread.run(Thread.java:724)
"RMI TCP Accept-9099" daemon prio=10 tid=0x00007ff4a45c6000 nid=0x72cd runnable
[0x00007ff4987fe000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
at java.net.ServerSocket.implAccept(ServerSocket.java:530)
at java.net.ServerSocket.accept(ServerSocket.java:498)
at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387)
at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359)
at java.lang.Thread.run(Thread.java:724)
"RMI TCP Accept-8999" daemon prio=10 tid=0x00007ff4a41a5800 nid=0x72cc runnable
[0x00007ff4988ff000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
at java.net.ServerSocket.implAccept(ServerSocket.java:530)
at
org.apache.qpid.server.jmx.RegistryProtectingRMIServerSocketFactory$NoLocalAddressServerSocket.accept(RegistryProtectingRMIServerSocketFactory.java:74)
at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:387)
at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:359)
at java.lang.Thread.run(Thread.java:724)
"HttpManagement-16" prio=10 tid=0x00007ff4a47b8000 nid=0x72c9 waiting on
condition [0x00007ff498c02000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078ab6a720> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at
java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:389)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:724)
"HttpManagement-15 Selector0" prio=10 tid=0x00007ff4a47b7000 nid=0x72c8
runnable [0x00007ff498d03000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
- locked <0x000000078ab78af0> (a sun.nio.ch.Util$2)
- locked <0x000000078ab78a68> (a java.util.Collections$UnmodifiableSet)
- locked <0x000000078ab787d8> (a sun.nio.ch.EPollSelectorImpl)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at
org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
at
org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:724)
"HttpManagement-14 Acceptor0 [email protected]:8080" prio=10
tid=0x00007ff4a47b5000 nid=0x72c7 runnable [0x00007ff498e04000]
java.lang.Thread.State: RUNNABLE
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:241)
- locked <0x000000078ab6b308> (a java.lang.Object)
at
org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
at
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:724)
"HashSessionScavenger-0" daemon prio=10 tid=0x00007ff4a47b2000 nid=0x72c6 in
Object.wait() [0x00007ff498f05000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000078ab55460> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:552)
- locked <0x000000078ab55460> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:505)
"IoNetworkAcceptor - 0.0.0.0/0.0.0.0:5672" prio=10 tid=0x00007ff4a4767800
nid=0x72c5 runnable [0x00007ff499006000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:398)
at java.net.ServerSocket.implAccept(ServerSocket.java:530)
at java.net.ServerSocket.accept(ServerSocket.java:498)
at
org.apache.qpid.transport.network.io.IoNetworkTransport$AcceptingThread.run(IoNetworkTransport.java:247)
"Broker-Configuration-Thread" prio=10 tid=0x00007ff4a4739000 nid=0x72c3 waiting
on condition [0x00007ff499208000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078a6fd978> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"Service Thread" daemon prio=10 tid=0x00007ff4a41a0800 nid=0x72b0 runnable
[0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread1" daemon prio=10 tid=0x00007ff4a419e000 nid=0x72af waiting
on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"C2 CompilerThread0" daemon prio=10 tid=0x00007ff4a419b800 nid=0x72ae waiting
on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" daemon prio=10 tid=0x00007ff4a4199800 nid=0x72ad runnable
[0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Surrogate Locker Thread (Concurrent GC)" daemon prio=10 tid=0x00007ff4a4197800
nid=0x72ac waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" daemon prio=10 tid=0x00007ff4a413e000 nid=0x72ab in Object.wait()
[0x00007ff49a7ae000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000078a6f70f0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)
- locked <0x000000078a6f70f0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:189)
"Reference Handler" daemon prio=10 tid=0x00007ff4a413b800 nid=0x72aa in
Object.wait() [0x00007ff49a8af000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000078a6f70a8> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:503)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)
- locked <0x000000078a6f70a8> (a java.lang.ref.Reference$Lock)
"VM Thread" prio=10 tid=0x00007ff4a4133000 nid=0x72a9 runnable
"Gang worker#0 (Parallel GC Threads)" prio=10 tid=0x00007ff4a4014000 nid=0x72a4
runnable
"Gang worker#1 (Parallel GC Threads)" prio=10 tid=0x00007ff4a4016000 nid=0x72a5
runnable
"Gang worker#2 (Parallel GC Threads)" prio=10 tid=0x00007ff4a4017800 nid=0x72a6
runnable
"Gang worker#3 (Parallel GC Threads)" prio=10 tid=0x00007ff4a4019800 nid=0x72a7
runnable
"Concurrent Mark-Sweep GC Thread" prio=10 tid=0x00007ff4a40a8800 nid=0x72a8
runnable
"VM Periodic Task Thread" prio=10 tid=0x00007ff4a41b3800 nid=0x72b1 waiting on
condition
JNI global references: 189
Found one Java-level deadlock:
=============================
"pool-3-thread-21":
waiting to lock monitor 0x00007ff43401e888 (object 0x000000078ae98b80, a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint),
which is held by "IoReceiver - /127.0.0.1:32922"
"IoReceiver - /127.0.0.1:32922":
waiting for ownable synchronizer 0x000000078b97a658, (a
java.util.concurrent.locks.ReentrantLock$NonfairSync),
which is held by "pool-3-thread-21"
Java stack information for the threads listed above:
===================================================
"pool-3-thread-21":
at
org.apache.qpid.server.protocol.v1_0.ConsumerTarget_1_0.send(ConsumerTarget_1_0.java:224)
- waiting to lock <0x000000078ae98b80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at
org.apache.qpid.server.protocol.v1_0.ConsumerTarget_1_0.send(ConsumerTarget_1_0.java:120)
at
org.apache.qpid.server.queue.QueueConsumerImpl.send(QueueConsumerImpl.java:469)
at
org.apache.qpid.server.queue.AbstractQueue.deliverMessage(AbstractQueue.java:1323)
at
org.apache.qpid.server.queue.AbstractQueue.attemptDelivery(AbstractQueue.java:2069)
at
org.apache.qpid.server.queue.AbstractQueue.processQueue(AbstractQueue.java:2237)
at org.apache.qpid.server.queue.QueueRunner$1.run(QueueRunner.java:77)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at org.apache.qpid.server.queue.QueueRunner.run(QueueRunner.java:68)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"IoReceiver - /127.0.0.1:32922":
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078b97a658> (a
java.util.concurrent.locks.ReentrantLock$NonfairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:867)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1197)
at
java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:214)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:290)
at
org.apache.qpid.server.consumer.AbstractConsumerTarget.getSendLock(AbstractConsumerTarget.java:131)
at
org.apache.qpid.server.queue.QueueConsumerImpl.getSendLock(QueueConsumerImpl.java:423)
at
org.apache.qpid.server.queue.AbstractQueue.flushConsumer(AbstractQueue.java:1978)
at
org.apache.qpid.server.queue.AbstractQueue.flushConsumer(AbstractQueue.java:1957)
at
org.apache.qpid.server.queue.QueueConsumerImpl.flush(QueueConsumerImpl.java:318)
at
org.apache.qpid.server.protocol.v1_0.ConsumerTarget_1_0.flush(ConsumerTarget_1_0.java:354)
at
org.apache.qpid.server.protocol.v1_0.SendingLink_1_0.flowStateChanged(SendingLink_1_0.java:499)
at
org.apache.qpid.server.protocol.v1_0.Session_1_0$SubjectSpecificSendingLinkListener$1.run(Session_1_0.java:822)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at
org.apache.qpid.server.protocol.v1_0.Session_1_0$SubjectSpecificSendingLinkListener.flowStateChanged(Session_1_0.java:817)
at
org.apache.qpid.amqp_1_0.transport.SendingLinkEndpoint.receiveFlow(SendingLinkEndpoint.java:165)
at
org.apache.qpid.amqp_1_0.transport.SessionEndpoint.receiveFlow(SessionEndpoint.java:471)
- locked <0x000000078ae98b80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint.receiveFlow(ConnectionEndpoint.java:671)
- locked <0x000000078ae98b80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at org.apache.qpid.amqp_1_0.type.transport.Flow.invoke(Flow.java:288)
at
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint.receive(ConnectionEndpoint.java:803)
- locked <0x000000078ae98b80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at
org.apache.qpid.amqp_1_0.framing.FrameHandler.parse(FrameHandler.java:241)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL$4.run(ProtocolEngine_1_0_0_SASL.java:384)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL$4.run(ProtocolEngine_1_0_0_SASL.java:380)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL.received(ProtocolEngine_1_0_0_SASL.java:379)
- locked <0x000000078b8e61c0> (a
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL.received(ProtocolEngine_1_0_0_SASL.java:66)
at
org.apache.qpid.server.protocol.MultiVersionProtocolEngine.received(MultiVersionProtocolEngine.java:153)
at
org.apache.qpid.server.protocol.MultiVersionProtocolEngine.received(MultiVersionProtocolEngine.java:51)
at
org.apache.qpid.transport.network.io.IoReceiver.run(IoReceiver.java:161)
at java.lang.Thread.run(Thread.java:724)
Found one Java-level deadlock:
=============================
"pool-3-thread-14":
waiting to lock monitor 0x00007ff43401f458 (object 0x000000078b060f80, a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint),
which is held by "IoReceiver - /127.0.0.1:32918"
"IoReceiver - /127.0.0.1:32918":
waiting for ownable synchronizer 0x000000078b693670, (a
java.util.concurrent.locks.ReentrantLock$NonfairSync),
which is held by "pool-3-thread-14"
Java stack information for the threads listed above:
===================================================
"pool-3-thread-14":
at
org.apache.qpid.server.protocol.v1_0.ConsumerTarget_1_0.allocateCredit(ConsumerTarget_1_0.java:299)
- waiting to lock <0x000000078b060f80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at
org.apache.qpid.server.queue.QueueConsumerImpl.wouldSuspend(QueueConsumerImpl.java:278)
at
org.apache.qpid.server.queue.AbstractQueue.attemptDelivery(AbstractQueue.java:2059)
at
org.apache.qpid.server.queue.AbstractQueue.processQueue(AbstractQueue.java:2237)
at org.apache.qpid.server.queue.QueueRunner$1.run(QueueRunner.java:77)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at org.apache.qpid.server.queue.QueueRunner.run(QueueRunner.java:68)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
"IoReceiver - /127.0.0.1:32918":
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000078b693670> (a
java.util.concurrent.locks.ReentrantLock$NonfairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:834)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireQueued(AbstractQueuedSynchronizer.java:867)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquire(AbstractQueuedSynchronizer.java:1197)
at
java.util.concurrent.locks.ReentrantLock$NonfairSync.lock(ReentrantLock.java:214)
at java.util.concurrent.locks.ReentrantLock.lock(ReentrantLock.java:290)
at
org.apache.qpid.server.consumer.AbstractConsumerTarget.getSendLock(AbstractConsumerTarget.java:131)
at
org.apache.qpid.server.queue.QueueConsumerImpl.getSendLock(QueueConsumerImpl.java:423)
at
org.apache.qpid.server.queue.AbstractQueue.flushConsumer(AbstractQueue.java:1978)
at
org.apache.qpid.server.queue.AbstractQueue.flushConsumer(AbstractQueue.java:1957)
at
org.apache.qpid.server.queue.QueueConsumerImpl.flush(QueueConsumerImpl.java:318)
at
org.apache.qpid.server.protocol.v1_0.ConsumerTarget_1_0.flush(ConsumerTarget_1_0.java:354)
at
org.apache.qpid.server.protocol.v1_0.SendingLink_1_0.flowStateChanged(SendingLink_1_0.java:499)
at
org.apache.qpid.server.protocol.v1_0.Session_1_0$SubjectSpecificSendingLinkListener$1.run(Session_1_0.java:822)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at
org.apache.qpid.server.protocol.v1_0.Session_1_0$SubjectSpecificSendingLinkListener.flowStateChanged(Session_1_0.java:817)
at
org.apache.qpid.amqp_1_0.transport.SendingLinkEndpoint.receiveFlow(SendingLinkEndpoint.java:165)
at
org.apache.qpid.amqp_1_0.transport.SessionEndpoint.receiveFlow(SessionEndpoint.java:471)
- locked <0x000000078b060f80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint.receiveFlow(ConnectionEndpoint.java:671)
- locked <0x000000078b060f80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at org.apache.qpid.amqp_1_0.type.transport.Flow.invoke(Flow.java:288)
at
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint.receive(ConnectionEndpoint.java:803)
- locked <0x000000078b060f80> (a
org.apache.qpid.amqp_1_0.transport.ConnectionEndpoint)
at
org.apache.qpid.amqp_1_0.framing.FrameHandler.parse(FrameHandler.java:241)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL$4.run(ProtocolEngine_1_0_0_SASL.java:384)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL$4.run(ProtocolEngine_1_0_0_SASL.java:380)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:356)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL.received(ProtocolEngine_1_0_0_SASL.java:379)
- locked <0x000000078b056bd0> (a
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL)
at
org.apache.qpid.server.protocol.v1_0.ProtocolEngine_1_0_0_SASL.received(ProtocolEngine_1_0_0_SASL.java:66)
at
org.apache.qpid.server.protocol.MultiVersionProtocolEngine.received(MultiVersionProtocolEngine.java:153)
at
org.apache.qpid.server.protocol.MultiVersionProtocolEngine.received(MultiVersionProtocolEngine.java:51)
at
org.apache.qpid.transport.network.io.IoReceiver.run(IoReceiver.java:161)
at java.lang.Thread.run(Thread.java:724)
Found 2 deadlocks.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
