Hi Jaroslaw,
I use 4.1.1 - but I'll try the newer version.
OutOfMemory didn't occur - actually the cases are pretty small.
the attachment contains the Thread dump. I hope that works for user list!
Thx for the fast reply
Best Regards
Dietmar
On Tue, Dec 7, 2010 at 5:51 PM, Jaroslaw Cwiklik <[email protected]> wrote:
> Hi, can you provide a full trace from a thread that is stuck on
> AbstractQueuedSynchronizer.
> Which version of ActiveMQ are you using? If 4.1.1, perhaps you can try a
> newer version like 5.3.2. Once you download new AMQ, just set ACTIVEMQ_HOME
> to point to the AMQ install dir.
>
> The fact that there are msgs in temp reply queues suggests that AMQ
> MessageListener threads are stuck somewhere and not processing incoming
> reply msgs.Perhaps there is synchronization problem either in UIMA AS or
> ActiveMQ.
>
> Have you checked the client log and/or stdout for OutOfMemory Error? You
> seem to be using quite a few CASes. Check JVM memory setting just in case.
>
> Regards, Jerry C
>
> 2010/12/7 Dietmar Gräbner <[email protected]>
>
>> Hi,
>>
>> I hope you can help me with a problem I am struggling with for quite a
>> while now.
>>
>> I wrote a test client creating multiple threads. Each thread
>> instantiates a BaseUIMAAsynchronousEngine_impl and invokes a uima
>> aggregate with the sendAndReceiveCAS() call. When running the program
>> with e.g. 100 Threads the client gets stuck after processing X calls.
>>
>> Environment:
>> -client:
>> - - uses the uima 2.3.0-incubating
>> - - the client is a modified copy of the RunRemoteAE.java uima
>> provides as an example
>> - - no timeouts configured except MetaTimeout
>>
>> -server:
>> - - server runs on a different machine
>> - - 2.3.0 with JMX configured to monitor activeMq and the Uima Services
>> - - Deployment Descriptor
>> - - - the uima service has two delegates: WhitespaceTokenizer and a
>> SentenceAnnotator
>> - - - no extra error handling configured (see at the end of the email)
>>
>>
>>
>> Detailed problem description:
>>
>> - The UIMA service reports in the JMX stats that all documents have
>> been processed. The individual delegate logs report that the process
>> method has been finished.
>> - Some of the client threads are blocked at the
>> AbstractQueuedSynchronizer. The others finished sucessfully.
>> - The Temp Queues in Active MQ still exist. Some are containing
>> messages and there are differences in the enqueue and dequeue counts.
>> - I experimented with different configuration parameters in the AS
>> deploment descriptor, though I don't think that this is the problem.
>> - Everything works fine with a primitve UIMA Service.
>> - I set the log settings to ALL, but couldn't find any Exceptions.
>>
>>
>> Thank you in advance.
>>
>> Best regards,
>>
>> Dietmar
>>
>>
>> -----
>> the most simple descriptor I used (I also tried 1 instance per used
>> thread):
>>
>> <analysisEngineDeploymentDescription
>> xmlns="http://uima.apache.org/resourceSpecifier";>
>> <name>SentenceAnnotator</name>
>> <description>Deploys SentenceAnnotator AE</description>
>> <deployment protocol="jms" provider="activemq" >
>> <service>
>> <inputQueue endpoint="SentenceAnnotatorQueue"
>> brokerURL="${defaultBrokerURL}"/>
>> <topDescriptor>
>> <import location="AAE_WSTokenizerSentenceAnnotator.xml"/>
>> </topDescriptor>
>> <analysisEngine async="true" key="SentenceAnnotator"
>> internalReplyQueueScaleout="1" inputQueueScaleout="1">
>> <delegates>
>> <analysisEngine key="SentenceAnnotator">
>> <scaleout numberOfInstances="1"/>
>> </analysisEngine>
>> <analysisEngine key ="WhitespaceTokenizer">
>> <scaleout numberOfInstances="1"/>
>> </analysisEngine>
>> </delegates>
>> </analysisEngine>
>> </service>
>> </deployment>
>>
>
2010-12-07 18:38:47
Full thread dump Java HotSpot(TM) 64-Bit Server VM (16.0-b13 mixed mode):
"RMI TCP Connection(3)-192.168.2.134" daemon prio=6 tid=0x0000000007e05800
nid=0xf34 runnable [0x00000000099ef000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
- locked <0x00000000eaf9d4e0> (a java.io.BufferedInputStream)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at
sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:517)
at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- <0x00000000eadac250> (a
java.util.concurrent.locks.ReentrantLock$NonfairSync)
"RMI TCP Connection(2)-192.168.2.134" daemon prio=6 tid=0x0000000007e08800
nid=0x1dac in Object.wait() [0x00000000098ed000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000eaf230d8> (a
com.sun.jmx.remote.internal.ArrayNotificationBuffer)
at
com.sun.jmx.remote.internal.ArrayNotificationBuffer.fetchNotifications(ArrayNotificationBuffer.java:417)
- locked <0x00000000eaf230d8> (a
com.sun.jmx.remote.internal.ArrayNotificationBuffer)
at
com.sun.jmx.remote.internal.ArrayNotificationBuffer$ShareBuffer.fetchNotifications(ArrayNotificationBuffer.java:209)
at
com.sun.jmx.remote.internal.ServerNotifForwarder.fetchNotifs(ServerNotifForwarder.java:258)
at
javax.management.remote.rmi.RMIConnectionImpl$2.run(RMIConnectionImpl.java:1227)
at
javax.management.remote.rmi.RMIConnectionImpl$2.run(RMIConnectionImpl.java:1225)
at
javax.management.remote.rmi.RMIConnectionImpl.fetchNotifications(RMIConnectionImpl.java:1231)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305)
at sun.rmi.transport.Transport$1.run(Transport.java:159)
at java.security.AccessController.doPrivileged(Native Method)
at sun.rmi.transport.Transport.serviceCall(Transport.java:155)
at
sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535)
at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- <0x00000000eada9970> (a
java.util.concurrent.locks.ReentrantLock$NonfairSync)
"JMX server connection timeout 433" daemon prio=6 tid=0x0000000007e0f000
nid=0x1798 in Object.wait() [0x00000000097ef000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000eae07740> (a [I)
at
com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java:150)
- locked <0x00000000eae07740> (a [I)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"RMI Scheduler(0)" daemon prio=6 tid=0x0000000007e00800 nid=0x1a30 waiting on
condition [0x000000000955f000]
java.lang.Thread.State: TIMED_WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000000ea76c4a8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:1963)
at java.util.concurrent.DelayQueue.take(DelayQueue.java:164)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:583)
at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:576)
at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"RMI TCP Connection(1)-192.168.2.134" daemon prio=6 tid=0x0000000007e07000
nid=0x1d18 runnable [0x000000000945f000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
- locked <0x00000000eadb10b0> (a java.io.BufferedInputStream)
at java.io.FilterInputStream.read(FilterInputStream.java:66)
at
sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:517)
at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790)
at
sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- <0x00000000eada7058> (a
java.util.concurrent.locks.ReentrantLock$NonfairSync)
"RMI TCP Accept-0" daemon prio=6 tid=0x0000000007e01000 nid=0x1ea4 runnable
[0x00000000092ef000]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:390)
- locked <0x00000000ea7720e0> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:453)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at
sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:34)
at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"DestroyJavaVM" prio=6 tid=0x0000000011063800 nid=0x1da0 waiting on condition
[0x0000000000000000]
java.lang.Thread.State: RUNNABLE
Locked ownable synchronizers:
- None
"Thread-196" prio=6 tid=0x0000000011061000 nid=0xc34 waiting on condition
[0x0000000012a9f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000000856f8720> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl$1.run(BaseUIMAAsynchronousEngineCommon_impl.java:509)
Locked ownable synchronizers:
- None
"Thread-157" prio=6 tid=0x0000000007d12000 nid=0xe20 waiting on condition
[0x000000001359f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x0000000085da9890> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl$1.run(BaseUIMAAsynchronousEngineCommon_impl.java:509)
Locked ownable synchronizers:
- None
"Thread-142" prio=6 tid=0x0000000007d0c800 nid=0x16f4 waiting on condition
[0x0000000012d9f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x0000000087013870> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl$1.run(BaseUIMAAsynchronousEngineCommon_impl.java:509)
Locked ownable synchronizers:
- None
"Thread-127" prio=6 tid=0x0000000007077000 nid=0x1ae4 waiting on condition
[0x000000001289f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000000854a0e20> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl$1.run(BaseUIMAAsynchronousEngineCommon_impl.java:509)
Locked ownable synchronizers:
- None
"Thread-119" prio=6 tid=0x00000000083b5000 nid=0x13e0 waiting on condition
[0x000000001229f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000000871e8678> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl$1.run(BaseUIMAAsynchronousEngineCommon_impl.java:509)
Locked ownable synchronizers:
- None
"Thread-75" prio=6 tid=0x0000000007bad000 nid=0x1548 waiting on condition
[0x000000000e14f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000000856f9178> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at
org.apache.uima.adapter.jms.client.BaseMessageSender.run(BaseMessageSender.java:265)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"Thread-64" prio=6 tid=0x0000000007bc7800 nid=0x1f7c waiting on condition
[0x000000000d94f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000000871fb2d0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at
org.apache.uima.adapter.jms.client.BaseMessageSender.run(BaseMessageSender.java:265)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"Thread-51" prio=6 tid=0x0000000007bc1000 nid=0x1f70 waiting on condition
[0x000000000d04f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000000871e90e8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at
org.apache.uima.adapter.jms.client.BaseMessageSender.run(BaseMessageSender.java:265)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"Thread-49" prio=6 tid=0x0000000007bbe000 nid=0x1098 waiting on condition
[0x000000000cc4f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x0000000085daa2e8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at
org.apache.uima.adapter.jms.client.BaseMessageSender.run(BaseMessageSender.java:265)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"Thread-48" prio=6 tid=0x0000000007909000 nid=0x1f60 waiting on condition
[0x000000000c74f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000008675e6d8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at
org.apache.uima.adapter.jms.client.BaseMessageSender.run(BaseMessageSender.java:265)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"Thread-29" prio=6 tid=0x000000000775f000 nid=0xea8 waiting on condition
[0x000000000b44f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000000856fbf70> (a
java.util.concurrent.Semaphore$NonfairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:905)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1217)
at java.util.concurrent.Semaphore.acquire(Semaphore.java:286)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl.waitForCpcReply(BaseUIMAAsynchronousEngineCommon_impl.java:672)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl.collectionProcessingComplete(BaseUIMAAsynchronousEngineCommon_impl.java:371)
- locked <0x00000000856f18a8> (a
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngine_impl)
at
com.lingrep.processing.client.perf.DirectAsyncAEWorkerThread.run(DirectAsyncAEWorkerThread.java:190)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"ActiveMQ Scheduler" daemon prio=6 tid=0x0000000007758800 nid=0x13dc in
Object.wait() [0x000000000ab4f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000085493108> (a java.lang.Object)
at java.lang.Object.wait(Object.java:443)
at
edu.emory.mathcs.backport.java.util.concurrent.TimeUnit.timedWait(TimeUnit.java:301)
at
edu.emory.mathcs.backport.java.util.concurrent.DelayQueue.take(DelayQueue.java:156)
- locked <0x0000000085493108> (a java.lang.Object)
at
edu.emory.mathcs.backport.java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:590)
at
edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:477)
at
edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"ActiveMQ Scheduler" daemon prio=6 tid=0x0000000007758000 nid=0x1f54 in
Object.wait() [0x000000000aa4f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000085493108> (a java.lang.Object)
at java.lang.Object.wait(Object.java:443)
at
edu.emory.mathcs.backport.java.util.concurrent.TimeUnit.timedWait(TimeUnit.java:301)
at
edu.emory.mathcs.backport.java.util.concurrent.DelayQueue.take(DelayQueue.java:156)
- locked <0x0000000085493108> (a java.lang.Object)
at
edu.emory.mathcs.backport.java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:590)
at
edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:477)
at
edu.emory.mathcs.backport.java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:674)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"ActiveMQ Transport: tcp:///143.205.174.93:61616" prio=6 tid=0x0000000007757000
nid=0x1f80 runnable [0x000000000a94f000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at
org.apache.activemq.transport.tcp.TcpBufferedInputStream.fill(TcpBufferedInputStream.java:49)
at
org.apache.activemq.transport.tcp.TcpBufferedInputStream.read(TcpBufferedInputStream.java:56)
at java.io.DataInputStream.readInt(DataInputStream.java:370)
at
org.apache.activemq.openwire.OpenWireFormat.unmarshal(OpenWireFormat.java:267)
at
org.apache.activemq.transport.tcp.TcpTransport.readCommand(TcpTransport.java:156)
at
org.apache.activemq.transport.tcp.TcpTransport.run(TcpTransport.java:136)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"Thread-16" prio=6 tid=0x0000000007753000 nid=0x1550 waiting on condition
[0x0000000009bef000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000008700eb88> (a
java.util.concurrent.Semaphore$NonfairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:905)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1217)
at java.util.concurrent.Semaphore.acquire(Semaphore.java:286)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl.waitForCpcReply(BaseUIMAAsynchronousEngineCommon_impl.java:672)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl.collectionProcessingComplete(BaseUIMAAsynchronousEngineCommon_impl.java:371)
- locked <0x000000008607d920> (a
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngine_impl)
at
com.lingrep.processing.client.perf.DirectAsyncAEWorkerThread.run(DirectAsyncAEWorkerThread.java:190)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"Thread-11" prio=6 tid=0x0000000007637800 nid=0x1ed8 waiting on condition
[0x00000000096ef000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000000871eabf8> (a
java.util.concurrent.Semaphore$NonfairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:905)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1217)
at java.util.concurrent.Semaphore.acquire(Semaphore.java:286)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl.waitForCpcReply(BaseUIMAAsynchronousEngineCommon_impl.java:672)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl.collectionProcessingComplete(BaseUIMAAsynchronousEngineCommon_impl.java:371)
- locked <0x00000000871e4a78> (a
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngine_impl)
at
com.lingrep.processing.client.perf.DirectAsyncAEWorkerThread.run(DirectAsyncAEWorkerThread.java:190)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"Thread-6" prio=6 tid=0x0000000007a93000 nid=0x1f40 waiting on condition
[0x00000000091ef000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x0000000085dafe20> (a
java.util.concurrent.Semaphore$NonfairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:905)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1217)
at java.util.concurrent.Semaphore.acquire(Semaphore.java:286)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl.waitForCpcReply(BaseUIMAAsynchronousEngineCommon_impl.java:672)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl.collectionProcessingComplete(BaseUIMAAsynchronousEngineCommon_impl.java:371)
- locked <0x0000000085d9d9d0> (a
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngine_impl)
at
com.lingrep.processing.client.perf.DirectAsyncAEWorkerThread.run(DirectAsyncAEWorkerThread.java:190)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"Thread-1" prio=6 tid=0x0000000007343000 nid=0x1350 waiting on condition
[0x0000000008cef000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000000854a1950> (a
java.util.concurrent.Semaphore$NonfairSync)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:747)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:905)
at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1217)
at java.util.concurrent.Semaphore.acquire(Semaphore.java:286)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl.waitForCpcReply(BaseUIMAAsynchronousEngineCommon_impl.java:672)
at
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngineCommon_impl.collectionProcessingComplete(BaseUIMAAsynchronousEngineCommon_impl.java:371)
- locked <0x00000000871f4d60> (a
org.apache.uima.adapter.jms.client.BaseUIMAAsynchronousEngine_impl)
at
com.lingrep.processing.client.perf.DirectAsyncAEWorkerThread.run(DirectAsyncAEWorkerThread.java:190)
at java.lang.Thread.run(Thread.java:619)
Locked ownable synchronizers:
- None
"Low Memory Detector" daemon prio=6 tid=0x0000000006895000 nid=0x1f10 runnable
[0x0000000000000000]
java.lang.Thread.State: RUNNABLE
Locked ownable synchronizers:
- None
"CompilerThread1" daemon prio=10 tid=0x0000000006893800 nid=0x1ed4 waiting on
condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
Locked ownable synchronizers:
- None
"CompilerThread0" daemon prio=10 tid=0x000000000687d000 nid=0x1564 waiting on
condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
Locked ownable synchronizers:
- None
"Attach Listener" daemon prio=10 tid=0x0000000006875000 nid=0x1ef4 waiting on
condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
Locked ownable synchronizers:
- None
"Signal Dispatcher" daemon prio=10 tid=0x0000000006870000 nid=0x1f30 runnable
[0x0000000000000000]
java.lang.Thread.State: RUNNABLE
Locked ownable synchronizers:
- None
"Finalizer" daemon prio=8 tid=0x00000000003c9800 nid=0x15ac in Object.wait()
[0x000000000681f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000855556c0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
- locked <0x00000000855556c0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
Locked ownable synchronizers:
- None
"Reference Handler" daemon prio=10 tid=0x00000000003c2800 nid=0x1f00 in
Object.wait() [0x000000000671f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000854a6828> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:485)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
- locked <0x00000000854a6828> (a java.lang.ref.Reference$Lock)
Locked ownable synchronizers:
- None
"VM Thread" prio=10 tid=0x00000000003be000 nid=0x1ef0 runnable
"GC task thread#0 (ParallelGC)" prio=6 tid=0x0000000000319000 nid=0x17f4
runnable
"GC task thread#1 (ParallelGC)" prio=6 tid=0x000000000031a800 nid=0x1db4
runnable
"GC task thread#2 (ParallelGC)" prio=6 tid=0x000000000031c800 nid=0x1dc4
runnable
"GC task thread#3 (ParallelGC)" prio=6 tid=0x000000000031e000 nid=0x19d8
runnable
"VM Periodic Task Thread" prio=10 tid=0x00000000068be000 nid=0x1898 waiting on
condition
JNI global references: 1292
