Ignite.close method blocked indefinitely

userx Mon, 24 Dec 2018 07:10:10 -0800

Hi,

I am trying to write some data to IgniteCache (PersistentMode) from a
Igniteclient to an IgniteServer. My IgniteClient is a simple java program
which is serving some requests. As a matter of fact, the IgniteClient is
instantiated lazily from a java program ( a server serving requests),
connects to the cluster and stays there.
It starts a DataStreamer and for an argument sake i have given a timeout of
5 minutes to stream the data. If the Streamer is not able to do so (in case
of huge data), I purposely call ignite.close which should kill all the
threads initiated by IgniteClient and make the DataStreamer entries Garbage
so that GC can take care of the same and clean my java program heap. But to
my surprise, Ignite.close is in a TIMED_WAITING stage  and the Ignite
related threads started by IgniteClient do not get killed. Here is the
snapshot of thread dump.


"TCP Worker Pool-thread-1" #190 prio=5 os_prio=0 tid=0x00007f4d70001000
nid=0x40d3 waiting on condition [0x00007f4d9dda3000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.util.GridSpinReadWriteLock.writeLock(GridSpinReadWriteLock.java:206)
        at
org.apache.ignite.internal.util.GridSpinBusyLock.block(GridSpinBusyLock.java:76)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.closeEx(DataStreamerImpl.java:1222)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.closeEx(DataStreamerImpl.java:1207)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor.onKernalStop(DataStreamProcessor.java:155)
        at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2101)
        at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2049)
        at
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0(IgnitionEx.java:2588)
        - locked <0x00000004c3992740> (a
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance)
        at
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop(IgnitionEx.java:2551)
        at org.apache.ignite.internal.IgnitionEx.stop(IgnitionEx.java:372)
        at org.apache.ignite.Ignition.stop(Ignition.java:229)
        at org.apache.ignite.internal.IgniteKernal.close(IgniteKernal.java:3370)
        at
com.XXX.datagrid.DataGridClient.stopIgniteClient(DataGridClient.java:114)
        at com.XXX.datagrid.DataGridClient.writeAll(DataGridClient.java:208)
        at com.XXX.datagrid.DataGridClient.writeAll(DataGridClient.java:215)
        at com.XXX.datagrid.DataGridClient.writeToGrid(DataGridClient.java:146)
        at
com.XXX.calculator.components.PropertyMeasures.performIgnitePersistence(PropertyMeasures.java:1198)
        at
com.XXX.calculator.components.PropertyMeasures.execute(PropertyMeasures.java:251)
        at
com.XXX.indexfactory.pipeline.BusinessPipeline.execute(BusinessPipeline.java:225)
        at
com.XXX.indexfactory.pipeline.AlcyoneThread.runCalculation(AlcyoneThread.java:406)
        at
com.XXX.indexfactory.pipeline.AlcyoneThread.process(AlcyoneThread.java:160)
        at
com.XXX.calculator.XXXCalculator.executeWithResponseData(XXXCalculator.java:101)
        at
com.XXX.calculator.XXXCalculator.executeWithResponse(XXXCalculator.java:66)
        at
com.XXX.calculator.soa.server.CalculationRequestHandler.processCalculationRequest(CalculationRequestHandler.java:171)
        at
com.XXX.calculator.soa.server.CalculationRequestHandler.processRequest(CalculationRequestHandler.java:89)
        at 
com.XXX.alcyone.tcp.TCPSocketDispatcher.run(TCPSocketDispatcher.java:62)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)


Is there a way I can force kill the IgniteClient without killing my Java
Program from which the IgniteClient was initiated. Complete details of
thread dump.



2018-12-23 06:07:17
Full thread dump Java HotSpot(TM) 64-Bit Server VM (25.172-b11 mixed mode):

"RMI TCP Connection(idle)" #138899 daemon prio=5 os_prio=0
tid=0x00007f4db0008800 nid=0x60dc waiting on condition [0x00007f4cfddde000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000004c0763450> (a
java.util.concurrent.SynchronousQueue$TransferStack)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

"RMI TCP Connection(idle)" #138898 daemon prio=5 os_prio=0
tid=0x00007f4db0001000 nid=0x60db waiting on condition [0x00007f4e0c434000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000004c0763450> (a
java.util.concurrent.SynchronousQueue$TransferStack)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

"RMI TCP Connection(idle)" #138897 daemon prio=5 os_prio=0
tid=0x00007f4db0002000 nid=0x60da waiting on condition [0x00007f4cfebec000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000004c0763450> (a
java.util.concurrent.SynchronousQueue$TransferStack)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

"RMI TCP Connection(idle)" #138896 daemon prio=5 os_prio=0
tid=0x00007f4db0007800 nid=0x60d9 waiting on condition [0x00007f4d9c796000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000004c0763450> (a
java.util.concurrent.SynchronousQueue$TransferStack)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

"Attach Listener" #138891 daemon prio=9 os_prio=0 tid=0x00007f4dfc001000
nid=0x6042 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"pool-55917-thread-1" #136431 prio=5 os_prio=0 tid=0x00007f4d6c239000
nid=0x273e waiting on condition [0x00007f4d9c695000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000004c4fdaf28> (a
java.util.concurrent.Semaphore$NonfairSync)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer.parkAndCheckInterrupt(AbstractQueuedSynchronizer.java:836)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedInterruptibly(AbstractQueuedSynchronizer.java:997)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1304)
        at java.util.concurrent.Semaphore.acquire(Semaphore.java:467)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.acquireRemapSemaphore(DataStreamerImpl.java:700)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.load0(DataStreamerImpl.java:741)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.addDataInternal(DataStreamerImpl.java:641)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.addData(DataStreamerImpl.java:677)
        at
com.XXX.datagrid.DataGridClient$Writer.lambda$call$0(DataGridClient.java:332)
        at
com.XXX.datagrid.DataGridClient$Writer$$Lambda$95/39445546.accept(Unknown
Source)
        at
java.util.concurrent.ConcurrentHashMap.forEach(ConcurrentHashMap.java:1597)
        at com.XXX.datagrid.DataGridClient$Writer.call(DataGridClient.java:332)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

"sys-#337%0f279436-b4c0-466e-936c-98bc8e057c4d%" #136408 daemon prio=5
os_prio=0 tid=0x00007f4c7c001000 nid=0x83a waiting on condition
[0x00007f4cff7f6000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:177)
        at
org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:140)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.load0(DataStreamerImpl.java:771)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.access$1200(DataStreamerImpl.java:127)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl$5$1.run(DataStreamerImpl.java:894)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl$5$2.call(DataStreamerImpl.java:921)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl$5$2.call(DataStreamerImpl.java:909)
        at
org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6695)
        at
org.apache.ignite.internal.processors.closure.GridClosureProcessor$2.body(GridClosureProcessor.java:967)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

"pool-55916-thread-1" #136396 prio=5 os_prio=0 tid=0x00007f4d6c23e800
nid=0x5f86 waiting on condition [0x00007f4d9d09f000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000004ecb41748> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

"session-timeout-worker-#94%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69176
daemon prio=5 os_prio=0 tid=0x00007f4d3877b800 nid=0x3af2 waiting on
condition [0x00007f4d4cbd6000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.processors.rest.GridRestProcessor$4.body(GridRestProcessor.java:476)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"exchange-worker-#97%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69185 daemon
prio=5 os_prio=0 tid=0x00007f4d3875e000 nid=0x3aef waiting on condition
[0x00007f4d4d2d9000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:338)
        at
org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:217)
        at
org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:159)
        at
org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:151)
        at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body0(GridCachePartitionExchangeManager.java:2433)
        at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:2299)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"ignite-update-notifier-timer" #69184 daemon prio=5 os_prio=0
tid=0x00007f4d3875c000 nid=0x3aee in Object.wait() [0x00007f4d4d3da000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        - locked <0x00000004c38aec60> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

"upd-ver-checker" #69183 daemon prio=5 os_prio=0 tid=0x00007f4d3875b000
nid=0x3aed waiting on condition [0x00007f4d4d4db000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.processors.cluster.GridUpdateNotifier$1.run(GridUpdateNotifier.java:115)
        at java.lang.Thread.run(Thread.java:748)

"disco-event-worker-#96%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69182 daemon
prio=5 os_prio=0 tid=0x00007f4d38752000 nid=0x3aec waiting on condition
[0x00007f4d4d5dc000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000004c382f618> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryWorker.body0(GridDiscoveryManager.java:2758)
        at
org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$DiscoveryWorker.body(GridDiscoveryManager.java:2732)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"tcp-client-disco-msg-worker-#4%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69181 daemon prio=5 os_prio=0 tid=0x00007f4d38750800 nid=0x3aea waiting on
condition [0x00007f4d4d6dd000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000004c389cbc8> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingDeque.takeFirst(LinkedBlockingDeque.java:492)
        at
java.util.concurrent.LinkedBlockingDeque.take(LinkedBlockingDeque.java:680)
        at
org.apache.ignite.spi.discovery.tcp.ClientImpl$MessageWorker.body(ClientImpl.java:1564)
        at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

"tcp-client-disco-sock-reader-#3%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69180 daemon prio=5 os_prio=0 tid=0x00007f4d38749800 nid=0x3ae9 in
Object.wait() [0x00007f4d4d7de000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:502)
        at
org.apache.ignite.spi.discovery.tcp.ClientImpl$SocketReader.body(ClientImpl.java:1006)
        - locked <0x00000004c41bc608> (a java.lang.Object)
        at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

"tcp-client-disco-sock-writer-#2%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69179 daemon prio=5 os_prio=0 tid=0x00007f4d38748000 nid=0x3ae8 in
Object.wait() [0x00007f4d4d8df000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:502)
        at
org.apache.ignite.spi.discovery.tcp.ClientImpl$SocketWriter.body(ClientImpl.java:1245)
        - locked <0x00000004c3813c10> (a java.lang.Object)
        at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

"TcpDiscoverySpi.timer" #69178 daemon prio=5 os_prio=0
tid=0x00007f4d38744000 nid=0x3ae7 in Object.wait() [0x00007f4d4d9e0000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        - locked <0x00000004c382f570> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

"grid-nio-worker-client-listener-3-#93%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69175 prio=5 os_prio=0 tid=0x00007f4d38714800 nid=0x3ae5 runnable
[0x00007f4d4dde2000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c384f220> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c3813c28> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c38645d8> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-client-listener-2-#92%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69174 prio=5 os_prio=0 tid=0x00007f4d38713000 nid=0x3ae4 runnable
[0x00007f4d4dee3000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c386a8f8> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c383af70> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c38658b0> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-client-listener-1-#91%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69173 prio=5 os_prio=0 tid=0x00007f4d38711000 nid=0x3ae3 runnable
[0x00007f4d4dfe4000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c386c0f8> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c3826110> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c3866d58> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-client-listener-0-#90%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69172 prio=5 os_prio=0 tid=0x00007f4d38691800 nid=0x3ae2 runnable
[0x00007f4d4e0e5000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c381fc90> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c382f5a0> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c38685d0> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"nio-acceptor-#89%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69171 daemon
prio=5 os_prio=0 tid=0x00007f4d38690000 nid=0x3ae1 runnable
[0x00007f4d4e1e6000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c385bd90> (a sun.nio.ch.Util$3)
        - locked <0x00000004c385bd78> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c387f688> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:2870)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:2822)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"tcp-comm-worker-#1%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69170 daemon
prio=5 os_prio=0 tid=0x00007f4d38497800 nid=0x3adc waiting on condition
[0x00007f4d4e6e7000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000004c3813c40> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467)
        at
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi$CommunicationWorker.body(TcpCommunicationSpi.java:4207)
        at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62)

"grid-nio-worker-tcp-comm-15-#88%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69165 prio=5 os_prio=0 tid=0x00007f4d38495800 nid=0x3adb runnable
[0x00007f4d4e7e8000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c381fcb0> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c382f5b8> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c3868660> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-14-#87%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69164 prio=5 os_prio=0 tid=0x00007f4d38493800 nid=0x3ada runnable
[0x00007f4d4e8e9000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c384f240> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c3813b98> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c3864668> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-13-#86%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69163 prio=5 os_prio=0 tid=0x00007f4d38491800 nid=0x3ad9 runnable
[0x00007f4d4e9ea000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c386a918> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c383af28> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c3865940> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-12-#85%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69162 prio=5 os_prio=0 tid=0x00007f4d3848f800 nid=0x3ad8 runnable
[0x00007f4d4eaeb000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c386a938> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c383af40> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c38659d0> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-11-#84%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69161 prio=5 os_prio=0 tid=0x00007f4d3848e000 nid=0x3ad7 runnable
[0x00007f4d4ebec000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c386c118> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c3826128> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c3866de8> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-10-#83%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69160 prio=5 os_prio=0 tid=0x00007f4d382df800 nid=0x3ad6 runnable
[0x00007f4d4eced000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c386a958> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c383aef8> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c3865a60> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-9-#82%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69159 prio=5 os_prio=0 tid=0x00007f4d382dd800 nid=0x3ad5 runnable
[0x00007f4d4edee000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c386a978> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c383af10> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c3865af0> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-8-#81%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69158 prio=5 os_prio=0 tid=0x00007f4d382db800 nid=0x3ad4 runnable
[0x00007f4d4eeef000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c386c138> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c3826140> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c3866e78> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-7-#80%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69157 prio=5 os_prio=0 tid=0x00007f4d382d9800 nid=0x3ad3 runnable
[0x00007f4d4eff0000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c384f260> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c3813bb0> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c38646f8> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-6-#79%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69156 prio=5 os_prio=0 tid=0x00007f4d382d7800 nid=0x3ad2 runnable
[0x00007f4d4f0f1000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c384f280> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c3813bc8> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c3864788> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-5-#78%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69155 prio=5 os_prio=0 tid=0x00007f4d382d6000 nid=0x3ad1 runnable
[0x00007f4d4f1f2000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c381fc30> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c382f510> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c38686f0> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-4-#77%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69154 prio=5 os_prio=0 tid=0x00007f4d382d4000 nid=0x3ad0 runnable
[0x00007f4d4f2f3000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c381fc50> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c382f528> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c3868780> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-3-#76%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69153 prio=5 os_prio=0 tid=0x00007f4d382d2800 nid=0x3acf runnable
[0x00007f4d4f3f4000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c384f2a0> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c3813af0> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c3864818> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-2-#75%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69152 prio=5 os_prio=0 tid=0x00007f4d382d1800 nid=0x3ace runnable
[0x00007f4d4f5f6000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c381fc70> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c382f540> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c3868810> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-1-#74%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69151 prio=5 os_prio=0 tid=0x00007f4d382cc000 nid=0x3acd runnable
[0x00007f4d4f4f5000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c384f2c0> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c3813b08> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c38648a8> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-nio-worker-tcp-comm-0-#73%0f279436-b4c0-466e-936c-98bc8e057c4d%"
#69150 prio=5 os_prio=0 tid=0x00007f4d382cb800 nid=0x3acc runnable
[0x00007f4d4f7f8000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c3826b58> (a
org.apache.ignite.internal.util.nio.SelectedSelectionKeySet)
        - locked <0x00000004c382f558> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c38688a0> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2105)
        at
org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1764)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"nio-acceptor-#72%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69149 daemon
prio=5 os_prio=0 tid=0x00007f4d382ce000 nid=0x3acb runnable
[0x00007f4d4f6f7000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
        - locked <0x00000004c382f4c8> (a sun.nio.ch.Util$3)
        - locked <0x00000004c382f4b0> (a java.util.Collections$UnmodifiableSet)
        - locked <0x00000004c3868930> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.accept(GridNioServer.java:2870)
        at
org.apache.ignite.internal.util.nio.GridNioServer$GridNioAcceptWorker.body(GridNioServer.java:2822)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"grid-timeout-worker-#71%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69148
daemon prio=5 os_prio=0 tid=0x00007f4d382af800 nid=0x3abd in Object.wait()
[0x00007f4d4f8f9000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at
org.apache.ignite.internal.processors.timeout.GridTimeoutProcessor$TimeoutWorker.body(GridTimeoutProcessor.java:203)
        - locked <0x00000004c3813b20> (a java.lang.Object)
        at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
        at java.lang.Thread.run(Thread.java:748)

"ignite-clock" #69147 daemon prio=10 os_prio=0 tid=0x00007f4d382a4800
nid=0x3abc waiting on condition [0x00007f4d4f9fa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.util.IgniteUtils$22.run(IgniteUtils.java:3308)
        at java.lang.Thread.run(Thread.java:748)

"jvm-pause-detector-worker" #69140 daemon prio=5 os_prio=0
tid=0x00007f4d381d5000 nid=0x3ab5 waiting on condition [0x00007f4d544c5000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.LongJVMPauseDetector$1.run(LongJVMPauseDetector.java:90)

"data-streamer-stripe-31-#64%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69139
daemon prio=5 os_prio=0 tid=0x00007f4d38193000 nid=0x3ab4 waiting on
condition [0x00007f4d545c6000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-30-#63%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69138
daemon prio=5 os_prio=0 tid=0x00007f4d38191800 nid=0x3ab3 waiting on
condition [0x00007f4d546c7000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-29-#62%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69137
daemon prio=5 os_prio=0 tid=0x00007f4d3818f800 nid=0x3ab2 waiting on
condition [0x00007f4d547c8000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-28-#61%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69136
daemon prio=5 os_prio=0 tid=0x00007f4d3818d800 nid=0x3ab1 waiting on
condition [0x00007f4d548c9000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-27-#60%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69135
daemon prio=5 os_prio=0 tid=0x00007f4d3818b800 nid=0x3ab0 waiting on
condition [0x00007f4d549ca000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-26-#59%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69134
daemon prio=5 os_prio=0 tid=0x00007f4d38189800 nid=0x3aaf waiting on
condition [0x00007f4d54acb000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-25-#58%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69133
daemon prio=5 os_prio=0 tid=0x00007f4d38187800 nid=0x3aae waiting on
condition [0x00007f4d54bcc000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-24-#57%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69132
daemon prio=5 os_prio=0 tid=0x00007f4d38185800 nid=0x3aad waiting on
condition [0x00007f4d54ccd000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-23-#56%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69131
daemon prio=5 os_prio=0 tid=0x00007f4d38183800 nid=0x3aac waiting on
condition [0x00007f4d54dce000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-22-#55%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69130
daemon prio=5 os_prio=0 tid=0x00007f4d38181800 nid=0x3aab waiting on
condition [0x00007f4d54ecf000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-21-#54%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69129
daemon prio=5 os_prio=0 tid=0x00007f4d3817f800 nid=0x3aaa waiting on
condition [0x00007f4d54fd0000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-20-#53%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69128
daemon prio=5 os_prio=0 tid=0x00007f4d3817d800 nid=0x3aa9 waiting on
condition [0x00007f4d550d1000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-19-#52%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69127
daemon prio=5 os_prio=0 tid=0x00007f4d3817b000 nid=0x3aa8 waiting on
condition [0x00007f4d551d2000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-18-#51%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69126
daemon prio=5 os_prio=0 tid=0x00007f4d38179000 nid=0x3aa7 waiting on
condition [0x00007f4d552d3000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-17-#50%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69125
daemon prio=5 os_prio=0 tid=0x00007f4d38177000 nid=0x3aa6 waiting on
condition [0x00007f4d553d4000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-16-#49%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69124
daemon prio=5 os_prio=0 tid=0x00007f4d38175000 nid=0x3aa5 waiting on
condition [0x00007f4d554d5000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-15-#48%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69123
daemon prio=5 os_prio=0 tid=0x00007f4d38173000 nid=0x3aa4 waiting on
condition [0x00007f4d555d6000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-14-#47%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69122
daemon prio=5 os_prio=0 tid=0x00007f4d38171000 nid=0x3aa3 waiting on
condition [0x00007f4d556d7000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-13-#46%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69121
daemon prio=5 os_prio=0 tid=0x00007f4d3816f000 nid=0x3aa2 waiting on
condition [0x00007f4d557d8000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-12-#45%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69120
daemon prio=5 os_prio=0 tid=0x00007f4d3816d000 nid=0x3aa1 waiting on
condition [0x00007f4d558d9000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-11-#44%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69119
daemon prio=5 os_prio=0 tid=0x00007f4d3816b000 nid=0x3aa0 waiting on
condition [0x00007f4d559da000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-10-#43%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69118
daemon prio=5 os_prio=0 tid=0x00007f4d38169000 nid=0x3a9f waiting on
condition [0x00007f4d55adb000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-9-#42%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69117
daemon prio=5 os_prio=0 tid=0x00007f4d38167000 nid=0x3a9e waiting on
condition [0x00007f4d55bdc000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-8-#41%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69116
daemon prio=5 os_prio=0 tid=0x00007f4d38165000 nid=0x3a9d waiting on
condition [0x00007f4d55cdd000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-7-#40%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69115
daemon prio=5 os_prio=0 tid=0x00007f4d38163800 nid=0x3a9c waiting on
condition [0x00007f4d55dde000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-6-#39%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69114
daemon prio=5 os_prio=0 tid=0x00007f4d38161800 nid=0x3a9b waiting on
condition [0x00007f4d55edf000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-5-#38%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69113
daemon prio=5 os_prio=0 tid=0x00007f4d3815f800 nid=0x3a9a waiting on
condition [0x00007f4d55fe0000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-4-#37%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69112
daemon prio=5 os_prio=0 tid=0x00007f4d3815d800 nid=0x3a99 waiting on
condition [0x00007f4d560e1000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-3-#36%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69111
daemon prio=5 os_prio=0 tid=0x00007f4d3815b800 nid=0x3a98 waiting on
condition [0x00007f4d561e2000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-2-#35%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69110
daemon prio=5 os_prio=0 tid=0x00007f4d38159800 nid=0x3a97 waiting on
condition [0x00007f4d562e3000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-1-#34%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69109
daemon prio=5 os_prio=0 tid=0x00007f4d38157800 nid=0x3a96 waiting on
condition [0x00007f4d563e4000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"data-streamer-stripe-0-#33%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69108
daemon prio=5 os_prio=0 tid=0x00007f4d38156000 nid=0x3a95 waiting on
condition [0x00007f4d564e5000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-31-#32%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69107 daemon
prio=5 os_prio=0 tid=0x00007f4d38153800 nid=0x3a94 waiting on condition
[0x00007f4d565e6000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-30-#31%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69106 daemon
prio=5 os_prio=0 tid=0x00007f4d38151800 nid=0x3a93 waiting on condition
[0x00007f4d566e7000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-29-#30%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69105 daemon
prio=5 os_prio=0 tid=0x00007f4d3814f800 nid=0x3a92 waiting on condition
[0x00007f4d567e8000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-28-#29%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69104 daemon
prio=5 os_prio=0 tid=0x00007f4d3814d800 nid=0x3a91 waiting on condition
[0x00007f4d568e9000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-27-#28%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69103 daemon
prio=5 os_prio=0 tid=0x00007f4d3814b000 nid=0x3a90 waiting on condition
[0x00007f4d569ea000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-26-#27%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69102 daemon
prio=5 os_prio=0 tid=0x00007f4d38149000 nid=0x3a8f waiting on condition
[0x00007f4d56aeb000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-25-#26%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69101 daemon
prio=5 os_prio=0 tid=0x00007f4d38147000 nid=0x3a8e waiting on condition
[0x00007f4d56bec000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-24-#25%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69100 daemon
prio=5 os_prio=0 tid=0x00007f4d38145000 nid=0x3a8d waiting on condition
[0x00007f4d56ced000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-23-#24%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69099 daemon
prio=5 os_prio=0 tid=0x00007f4d38143800 nid=0x3a8c waiting on condition
[0x00007f4d56dee000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-22-#23%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69098 daemon
prio=5 os_prio=0 tid=0x00007f4d38141800 nid=0x3a8b waiting on condition
[0x00007f4d56eef000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-21-#22%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69097 daemon
prio=5 os_prio=0 tid=0x00007f4d3813f800 nid=0x3a8a waiting on condition
[0x00007f4d56ff0000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-20-#21%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69096 daemon
prio=5 os_prio=0 tid=0x00007f4d3813e000 nid=0x3a89 waiting on condition
[0x00007f4d570f1000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-19-#20%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69095 daemon
prio=5 os_prio=0 tid=0x00007f4d3813d000 nid=0x3a88 waiting on condition
[0x00007f4d573f2000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-18-#19%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69094 daemon
prio=5 os_prio=0 tid=0x00007f4d3813b800 nid=0x3a87 waiting on condition
[0x00007f4d9ce9d000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-17-#18%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69093 daemon
prio=5 os_prio=0 tid=0x00007f4d3813a000 nid=0x3a86 waiting on condition
[0x00007f4d4fffe000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-16-#17%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69092 daemon
prio=5 os_prio=0 tid=0x00007f4d38139000 nid=0x3a85 waiting on condition
[0x00007f4d578f7000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-15-#16%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69091 daemon
prio=5 os_prio=0 tid=0x00007f4d38137800 nid=0x3a84 waiting on condition
[0x00007f4d576f5000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-14-#15%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69090 daemon
prio=5 os_prio=0 tid=0x00007f4d38136800 nid=0x3a83 waiting on condition
[0x00007f4d9d3a0000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-13-#14%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69089 daemon
prio=5 os_prio=0 tid=0x00007f4d38135800 nid=0x3a82 waiting on condition
[0x00007f4d57af9000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-12-#13%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69088 daemon
prio=5 os_prio=0 tid=0x00007f4d38134800 nid=0x3a81 waiting on condition
[0x00007f4d574f3000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-11-#12%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69087 daemon
prio=5 os_prio=0 tid=0x00007f4d38133000 nid=0x3a80 waiting on condition
[0x00007f4d9c493000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-10-#11%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69086 daemon
prio=5 os_prio=0 tid=0x00007f4d38132000 nid=0x3a7f waiting on condition
[0x00007f4d9e4a9000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-9-#10%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69085 daemon
prio=5 os_prio=0 tid=0x00007f4d38131000 nid=0x3a7e waiting on condition
[0x00007f4cffefd000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-8-#9%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69084 daemon prio=5
os_prio=0 tid=0x00007f4d38130000 nid=0x3a7d waiting on condition
[0x00007f4d577f6000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-7-#8%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69083 daemon prio=5
os_prio=0 tid=0x00007f4d3812f000 nid=0x3a7c waiting on condition
[0x00007f4d579f8000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-6-#7%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69082 daemon prio=5
os_prio=0 tid=0x00007f4d3811a800 nid=0x3a7b waiting on condition
[0x00007f4d9ca99000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-5-#6%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69081 daemon prio=5
os_prio=0 tid=0x00007f4d38119800 nid=0x3a7a waiting on condition
[0x00007f4cffdfc000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-4-#5%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69080 daemon prio=5
os_prio=0 tid=0x00007f4d38114000 nid=0x3a79 waiting on condition
[0x00007f4d57ffe000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-3-#4%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69079 daemon prio=5
os_prio=0 tid=0x00007f4d38117800 nid=0x3a78 waiting on condition
[0x00007f4d9c998000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-2-#3%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69078 daemon prio=5
os_prio=0 tid=0x00007f4d38116800 nid=0x3a77 waiting on condition
[0x00007f4d9dba2000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-1-#2%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69077 daemon prio=5
os_prio=0 tid=0x00007f4d38115800 nid=0x3a76 waiting on condition
[0x00007f4d9cf9e000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"sys-stripe-0-#1%0f279436-b4c0-466e-936c-98bc8e057c4d%" #69076 daemon prio=5
os_prio=0 tid=0x00007f4d380ab000 nid=0x3a75 waiting on condition
[0x00007f4d9f3b1000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
        at
org.apache.ignite.internal.util.StripedExecutor$StripeConcurrentQueue.take(StripedExecutor.java:672)
        at
org.apache.ignite.internal.util.StripedExecutor$Stripe.run(StripedExecutor.java:505)
        at java.lang.Thread.run(Thread.java:748)

"TCP Worker Pool-thread-1" #190 prio=5 os_prio=0 tid=0x00007f4d70001000
nid=0x40d3 waiting on condition [0x00007f4d9dda3000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
org.apache.ignite.internal.util.GridSpinReadWriteLock.writeLock(GridSpinReadWriteLock.java:206)
        at
org.apache.ignite.internal.util.GridSpinBusyLock.block(GridSpinBusyLock.java:76)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.closeEx(DataStreamerImpl.java:1222)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl.closeEx(DataStreamerImpl.java:1207)
        at
org.apache.ignite.internal.processors.datastreamer.DataStreamProcessor.onKernalStop(DataStreamProcessor.java:155)
        at org.apache.ignite.internal.IgniteKernal.stop0(IgniteKernal.java:2101)
        at org.apache.ignite.internal.IgniteKernal.stop(IgniteKernal.java:2049)
        at
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop0(IgnitionEx.java:2588)
        - locked <0x00000004c3992740> (a
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance)
        at
org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.stop(IgnitionEx.java:2551)
        at org.apache.ignite.internal.IgnitionEx.stop(IgnitionEx.java:372)
        at org.apache.ignite.Ignition.stop(Ignition.java:229)
        at org.apache.ignite.internal.IgniteKernal.close(IgniteKernal.java:3370)
        at
com.XXX.datagrid.DataGridClient.stopIgniteClient(DataGridClient.java:114)
        at com.XXX.datagrid.DataGridClient.writeAll(DataGridClient.java:208)
        at com.XXX.datagrid.DataGridClient.writeAll(DataGridClient.java:215)
        at com.XXX.datagrid.DataGridClient.writeToGrid(DataGridClient.java:146)
        at
com.XXX.calculator.components.PropertyMeasures.performIgnitePersistence(PropertyMeasures.java:1198)
        at
com.XXX.calculator.components.PropertyMeasures.execute(PropertyMeasures.java:251)
        at
com.XXX.indexfactory.pipeline.BusinessPipeline.execute(BusinessPipeline.java:225)
        at
com.XXX.indexfactory.pipeline.AlcyoneThread.runCalculation(AlcyoneThread.java:406)
        at
com.XXX.indexfactory.pipeline.AlcyoneThread.process(AlcyoneThread.java:160)
        at
com.XXX.calculator.XXXCalculator.executeWithResponseData(XXXCalculator.java:101)
        at
com.XXX.calculator.XXXCalculator.executeWithResponse(XXXCalculator.java:66)
        at
com.XXX.calculator.soa.server.CalculationRequestHandler.processCalculationRequest(CalculationRequestHandler.java:171)
        at
com.XXX.calculator.soa.server.CalculationRequestHandler.processRequest(CalculationRequestHandler.java:89)
        at 
com.XXX.alcyone.tcp.TCPSocketDispatcher.run(TCPSocketDispatcher.java:62)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

"RMI Scheduler(0)" #44 daemon prio=5 os_prio=0 tid=0x00007f4d78007000
nid=0x2ec0 waiting on condition [0x00007f4d9dea5000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000004c0000630> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
        at
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

"AtlasDispatcherThread" #41 prio=5 os_prio=0 tid=0x00007f4eb53e0000
nid=0x2e6b in Object.wait() [0x00007f4d9dfa6000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:502)
        at
com.XXX.soa.server.AlcyoneRequestDispatcher.runAsDetached(AlcyoneRequestDispatcher.java:105)
        - locked <0x00000004c1632cf8> (a java.lang.Object)
        at
com.XXX.soa.server.AlcyoneRequestDispatcher.run(AlcyoneRequestDispatcher.java:68)
        at java.lang.Thread.run(Thread.java:748)

"pool-4-thread-1" #40 prio=5 os_prio=0 tid=0x00007f4eb53de800 nid=0x2e6a
runnable [0x00007f4d9e0a7000]
   java.lang.Thread.State: RUNNABLE
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at
com.XXX.alcyone.tcp.DefaultTCPServerImpl$DispatcherRunnable.run(DefaultTCPServerImpl.java:208)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

"SuspendDispatcherThread" #39 prio=5 os_prio=0 tid=0x00007f4eb539c000
nid=0x2e66 in Object.wait() [0x00007f4d9e3a8000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000004c000ed88> (a java.lang.Object)
        at java.lang.Object.wait(Object.java:502)
        at
org.apache.activemq.SimplePriorityMessageDispatchChannel.dequeue(SimplePriorityMessageDispatchChannel.java:87)
        - locked <0x00000004c000ed88> (a java.lang.Object)
        at
org.apache.activemq.ActiveMQMessageConsumer.dequeue(ActiveMQMessageConsumer.java:468)
        at
org.apache.activemq.ActiveMQMessageConsumer.receive(ActiveMQMessageConsumer.java:520)
        at
com.XXX.soa.server.AlcyoneJMSMessagingStrategy.receive(AlcyoneJMSMessagingStrategy.java:94)
        at
com.XXX.soa.server.AlcyoneJMSMessagingStrategy.getRequest(AlcyoneJMSMessagingStrategy.java:189)
        at
com.XXX.soa.server.AlcyoneRequestDispatcher.runAsAttached(AlcyoneRequestDispatcher.java:86)
        at
com.XXX.soa.server.AlcyoneRequestDispatcher.run(AlcyoneRequestDispatcher.java:67)
        at java.lang.Thread.run(Thread.java:748)

"SwatchThread" #37 prio=5 os_prio=0 tid=0x00007f4eb5574000 nid=0x2e58
waiting on condition [0x00007f4d9e5aa000]
   java.lang.Thread.State: TIMED_WAITING (sleeping)
        at java.lang.Thread.sleep(Native Method)
        at
com.XXX.soa.server.AlcyoneSwatchRunnable.run(AlcyoneSwatchRunnable.java:90)
        at java.lang.Thread.run(Thread.java:748)

"InactivityMonitor WriteCheck" #36 daemon prio=10 os_prio=0
tid=0x00007f4d88004800 nid=0x2e4c in Object.wait() [0x00007f4d9e6ab000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        - locked <0x00000004c00032a8> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

"InactivityMonitor ReadCheck" #35 daemon prio=10 os_prio=0
tid=0x00007f4d88003800 nid=0x2e4b in Object.wait() [0x00007f4d9e7ac000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        - locked <0x00000004c000eed8> (a java.util.TaskQueue)
        at java.util.TimerThread.run(Timer.java:505)

"ActiveMQ Transport: tcp://soa-prod/10.63.4.43:62617" #34 prio=10 os_prio=0
tid=0x00007f4d9404a800 nid=0x2e48 runnable [0x00007f4d9e8ad000]
   java.lang.Thread.State: RUNNABLE
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:171)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at
org.apache.activemq.transport.tcp.TcpBufferedInputStream.fill(TcpBufferedInputStream.java:50)
        at
org.apache.activemq.transport.tcp.TcpTransport$2.fill(TcpTransport.java:602)
        at
org.apache.activemq.transport.tcp.TcpBufferedInputStream.read(TcpBufferedInputStream.java:58)
        at
org.apache.activemq.transport.tcp.TcpTransport$2.read(TcpTransport.java:587)
        at java.io.DataInputStream.readInt(DataInputStream.java:387)
        at
org.apache.activemq.openwire.OpenWireFormat.unmarshal(OpenWireFormat.java:275)
        at
org.apache.activemq.transport.tcp.TcpTransport.readCommand(TcpTransport.java:229)
        at
org.apache.activemq.transport.tcp.TcpTransport.doRun(TcpTransport.java:221)
        at
org.apache.activemq.transport.tcp.TcpTransport.run(TcpTransport.java:204)
        at java.lang.Thread.run(Thread.java:748)

"AdminThread" #33 prio=10 os_prio=0 tid=0x00007f4eb565b000 nid=0x2e3e in
Object.wait() [0x00007f4d9edaf000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        - waiting on <0x00000004c0003320> (a java.lang.Object)
        at java.lang.Object.wait(Object.java:502)
        at
org.apache.activemq.SimplePriorityMessageDispatchChannel.dequeue(SimplePriorityMessageDispatchChannel.java:87)
        - locked <0x00000004c0003320> (a java.lang.Object)
        at
org.apache.activemq.ActiveMQMessageConsumer.dequeue(ActiveMQMessageConsumer.java:468)
        at
org.apache.activemq.ActiveMQMessageConsumer.receive(ActiveMQMessageConsumer.java:520)
        at
com.XXX.soa.server.JMSMessagingStrategy.receive(JMSMessagingStrategy.java:94)
        at
com.XXX.soa.server.JMSMessagingStrategy.getRequest(JMSMessagingStrategy.java:166)
        at
com.XXX.soa.server.SOARequestDispatcher.run(SOARequestDispatcher.java:55)
        at java.lang.Thread.run(Thread.java:748)

"XXX.ALCYONE-pool1-thread-1" #32 prio=5 os_prio=0 tid=0x00007f4eb5659000
nid=0x2e3b waiting on condition [0x00007f4d9eeb0000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000004c0013480> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

"Application Monitor Log Consumer" #27 daemon prio=5 os_prio=0
tid=0x00007f4eb4fa1000 nid=0x2db3 waiting on condition [0x00007f4e0c535000]
   java.lang.Thread.State: WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000004c000ef08> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at com.XXX.applicationmonitor.async.LogQueue.take(LogQueue.java:49)
        at
com.XXX.applicationmonitor.async.LoggingActionConsumerLoop$1.next(LoggingActionConsumerLoop.java:9)
        at
com.XXX.applicationmonitor.async.BaseLoggingActionConsumer.processQueue(BaseLoggingActionConsumer.java:60)
        at
com.XXX.applicationmonitor.async.BaseLoggingActionConsumer.run(BaseLoggingActionConsumer.java:51)
        at java.lang.Thread.run(Thread.java:748)

"Log4j2-TF-1-AsyncLogger[AsyncContext@764c12b6]-1" #25 daemon prio=5
os_prio=0 tid=0x00007f4eb4e97800 nid=0x2dab waiting on condition
[0x00007f4e0ca51000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000004c000eda0> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
com.lmax.disruptor.TimeoutBlockingWaitStrategy.waitFor(TimeoutBlockingWaitStrategy.java:38)
        at
com.lmax.disruptor.ProcessingSequenceBarrier.waitFor(ProcessingSequenceBarrier.java:56)
        at
com.lmax.disruptor.BatchEventProcessor.processEvents(BatchEventProcessor.java:159)
        at 
com.lmax.disruptor.BatchEventProcessor.run(BatchEventProcessor.java:125)
        at java.lang.Thread.run(Thread.java:748)

"RMI TCP Accept-0" #24 daemon prio=5 os_prio=0 tid=0x00007f4eb4d23000
nid=0x2d5a runnable [0x00007f4e0ce53000]
   java.lang.Thread.State: RUNNABLE
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at
sun.management.jmxremote.LocalRMIServerSocketFactory$1.accept(LocalRMIServerSocketFactory.java:52)
        at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:405)
        at 
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:377)
        at java.lang.Thread.run(Thread.java:748)

"RMI TCP Accept-15138" #23 daemon prio=5 os_prio=0 tid=0x00007f4eb4cff800
nid=0x2d50 runnable [0x00007f4e0cf54000]
   java.lang.Thread.State: RUNNABLE
        at java.net.PlainSocketImpl.socketAccept(Native Method)
        at
java.net.AbstractPlainSocketImpl.accept(AbstractPlainSocketImpl.java:409)
        at java.net.ServerSocket.implAccept(ServerSocket.java:545)
        at java.net.ServerSocket.accept(ServerSocket.java:513)
        at
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:405)
        at 
sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:377)
        at java.lang.Thread.run(Thread.java:748)

"Service Thread" #21 daemon prio=9 os_prio=0 tid=0x00007f4eb421e800
nid=0x2cc7 runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread14" #20 daemon prio=9 os_prio=0 tid=0x00007f4eb421b800
nid=0x2cc6 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread13" #19 daemon prio=9 os_prio=0 tid=0x00007f4eb4219000
nid=0x2cc5 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread12" #18 daemon prio=9 os_prio=0 tid=0x00007f4eb4217000
nid=0x2cc4 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread11" #17 daemon prio=9 os_prio=0 tid=0x00007f4eb4215000
nid=0x2cc3 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread10" #16 daemon prio=9 os_prio=0 tid=0x00007f4eb4213000
nid=0x2cc2 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread9" #15 daemon prio=9 os_prio=0 tid=0x00007f4eb4211000
nid=0x2cc0 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread8" #14 daemon prio=9 os_prio=0 tid=0x00007f4eb420e000
nid=0x2cbf waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread7" #13 daemon prio=9 os_prio=0 tid=0x00007f4eb420b800
nid=0x2cbe waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread6" #12 daemon prio=9 os_prio=0 tid=0x00007f4eb4209800
nid=0x2cbd waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread5" #11 daemon prio=9 os_prio=0 tid=0x00007f4eb4207800
nid=0x2cbb waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread4" #10 daemon prio=9 os_prio=0 tid=0x00007f4eb4205000
nid=0x2cb6 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread3" #9 daemon prio=9 os_prio=0 tid=0x00007f4eb41fb000
nid=0x2cb4 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread2" #8 daemon prio=9 os_prio=0 tid=0x00007f4eb41f8800
nid=0x2cb2 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread1" #7 daemon prio=9 os_prio=0 tid=0x00007f4eb41f6800
nid=0x2cb1 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C2 CompilerThread0" #6 daemon prio=9 os_prio=0 tid=0x00007f4eb41f4000
nid=0x2cb0 waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Signal Dispatcher" #5 daemon prio=9 os_prio=0 tid=0x00007f4eb41f2800
nid=0x2caf runnable [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Surrogate Locker Thread (Concurrent GC)" #4 daemon prio=9 os_prio=0
tid=0x00007f4eb41ed800 nid=0x2cad waiting on condition [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Finalizer" #3 daemon prio=8 os_prio=0 tid=0x00007f4eb41be800 nid=0x2c87 in
Object.wait() [0x00007f4e0f44f000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:144)
        - locked <0x00000004c00032d8> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:165)
        at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:216)

"Reference Handler" #2 daemon prio=10 os_prio=0 tid=0x00007f4eb41bc000
nid=0x2c7d in Object.wait() [0x00007f4e0f550000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:502)
        at java.lang.ref.Reference.tryHandlePending(Reference.java:191)
        - locked <0x00000004c0014500> (a java.lang.ref.Reference$Lock)
        at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:153)

"main" #1 prio=5 os_prio=0 tid=0x00007f4eb400b800 nid=0x2bb0 waiting on
condition [0x00007f4eb8c3a000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at sun.misc.Unsafe.park(Native Method)
        - parking to wait for  <0x00000004c000ef80> (a
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
        at
java.util.concurrent.ThreadPoolExecutor.awaitTermination(ThreadPoolExecutor.java:1475)
        at
java.util.concurrent.Executors$DelegatedExecutorService.awaitTermination(Executors.java:675)
        at
com.XXX.alcyone.tcp.DefaultTCPServerImpl.await(DefaultTCPServerImpl.java:133)
        at com.XXX.indexfactory.AlcyoneServer.start(AlcyoneServer.java:274)
        at com.XXX.indexfactory.AlcyoneServer.start(AlcyoneServer.java:173)
        at
com.XXX.calculator.soa.server.XXXServerCalculator.start(XXXServerCalculator.java:85)
        at
com.XXX.calculator.soa.server.XXXServerCalculator.main(XXXServerCalculator.java:127)

"VM Thread" os_prio=0 tid=0x00007f4eb41b2000 nid=0x2c52 runnable 

"Gang worker#0 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb401d000
nid=0x2bb7 runnable 

"Gang worker#1 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb401e800
nid=0x2bb8 runnable 

"Gang worker#2 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4020800
nid=0x2bb9 runnable 

"Gang worker#3 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4022800
nid=0x2bba runnable 

"Gang worker#4 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4024000
nid=0x2bbb runnable 

"Gang worker#5 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4026000
nid=0x2bbc runnable 

"Gang worker#6 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4028000
nid=0x2bbe runnable 

"Gang worker#7 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4029800
nid=0x2bbf runnable 

"Gang worker#8 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb402b800
nid=0x2bc0 runnable 

"Gang worker#9 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb402d000
nid=0x2bc1 runnable 

"Gang worker#10 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb402f000
nid=0x2bc2 runnable 

"Gang worker#11 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4031000
nid=0x2bc3 runnable 

"Gang worker#12 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4032800
nid=0x2bc4 runnable 

"Gang worker#13 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4034800
nid=0x2bc5 runnable 

"Gang worker#14 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4036800
nid=0x2bc6 runnable 

"Gang worker#15 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4038000
nid=0x2bc7 runnable 

"Gang worker#16 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb403a000
nid=0x2bc8 runnable 

"Gang worker#17 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb403c000
nid=0x2bc9 runnable 

"Gang worker#18 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb403d800
nid=0x2bca runnable 

"Gang worker#19 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb403f800
nid=0x2bcb runnable 

"Gang worker#20 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4041000
nid=0x2bcc runnable 

"Gang worker#21 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4043000
nid=0x2bcd runnable 

"Gang worker#22 (Parallel GC Threads)" os_prio=0 tid=0x00007f4eb4045000
nid=0x2bcf runnable 

"Concurrent Mark-Sweep GC Thread" os_prio=0 tid=0x00007f4eb415d800
nid=0x2c0a runnable 

"Gang worker#0 (Parallel CMS Threads)" os_prio=0 tid=0x00007f4eb4151800
nid=0x2bfc runnable 

"Gang worker#1 (Parallel CMS Threads)" os_prio=0 tid=0x00007f4eb4153800
nid=0x2bfe runnable 

"Gang worker#2 (Parallel CMS Threads)" os_prio=0 tid=0x00007f4eb4155800
nid=0x2c00 runnable 

"Gang worker#3 (Parallel CMS Threads)" os_prio=0 tid=0x00007f4eb4157000
nid=0x2c01 runnable 

"Gang worker#4 (Parallel CMS Threads)" os_prio=0 tid=0x00007f4eb4159000
nid=0x2c03 runnable 

"Gang worker#5 (Parallel CMS Threads)" os_prio=0 tid=0x00007f4eb415b000
nid=0x2c05 runnable 

"VM Periodic Task Thread" os_prio=0 tid=0x00007f4eb4d25800 nid=0x2d5c
waiting on condition 

JNI global references: 399







--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Ignite.close method blocked indefinitely

Reply via email to