Hello!
I imagine that maybe you have overwhelmed your system with I/O (HDD?
Swapping? Shared resources?):
Thread [name="data-streamer-stripe-4-#13%ignite-server-003%", id=27,
state=WAITING, blockCnt=0, waitCnt=343357]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:304)
at
o.a.i.i.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:178)
at
o.a.i.i.util.future.GridFutureAdapter.getUninterruptibly(GridFutureAdapter.java:146)
at
o.a.i.i.processors.cache.persistence.file.AsyncFileIO.read(AsyncFileIO.java:95)
at
o.a.i.i.processors.cache.persistence.file.AbstractFileIO$2.run(AbstractFileIO.java:91)
at
o.a.i.i.processors.cache.persistence.file.AbstractFileIO.fully(AbstractFileIO.java:54)
at
o.a.i.i.processors.cache.persistence.file.AbstractFileIO.readFully(AbstractFileIO.java:89)
at
o.a.i.i.processors.cache.persistence.file.FilePageStore.readWithFailover(FilePageStore.java:707)
at
o.a.i.i.processors.cache.persistence.file.FilePageStore.read(FilePageStore.java:345)
at
o.a.i.i.processors.cache.persistence.file.FilePageStoreManager.read(FilePageStoreManager.java:426)
at
o.a.i.i.processors.cache.persistence.file.FilePageStoreManager.read(FilePageStoreManager.java:410)
at
o.a.i.i.processors.cache.persistence.pagemem.PageMemoryImpl.acquirePage(PageMemoryImpl.java:806)
at
o.a.i.i.processors.cache.persistence.pagemem.PageMemoryImpl.acquirePage(PageMemoryImpl.java:649)
at
o.a.i.i.processors.cache.persistence.DataStructure.acquirePage(DataStructure.java:144)
at
o.a.i.i.processors.cache.persistence.tree.BPlusTree.putDown(BPlusTree.java:2489)
at
o.a.i.i.processors.cache.persistence.tree.BPlusTree.putDown(BPlusTree.java:2511)
at
o.a.i.i.processors.cache.persistence.tree.BPlusTree.putDown(BPlusTree.java:2511)
at
o.a.i.i.processors.cache.persistence.tree.BPlusTree.putDown(BPlusTree.java:2511)
at
o.a.i.i.processors.cache.persistence.tree.BPlusTree.doPut(BPlusTree.java:2252)
at
o.a.i.i.processors.cache.persistence.tree.BPlusTree.putx(BPlusTree.java:2232)
at
o.a.i.i.processors.query.h2.database.H2TreeIndex.putx(H2TreeIndex.java:299)
at
o.a.i.i.processors.query.h2.opt.GridH2Table.addToIndex(GridH2Table.java:546)
at
o.a.i.i.processors.query.h2.opt.GridH2Table.update(GridH2Table.java:479)
at
o.a.i.i.processors.query.h2.IgniteH2Indexing.store(IgniteH2Indexing.java:768)
at
o.a.i.i.processors.query.GridQueryProcessor.store(GridQueryProcessor.java:1905)
at
o.a.i.i.processors.cache.query.GridCacheQueryManager.store(GridCacheQueryManager.java:404)
at
o.a.i.i.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.finishUpdate(IgniteCacheOffheapManagerImpl.java:2633)
at
o.a.i.i.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke0(IgniteCacheOffheapManagerImpl.java:1646)
at
o.a.i.i.processors.cache.IgniteCacheOffheapManagerImpl$CacheDataStoreImpl.invoke(IgniteCacheOffheapManagerImpl.java:1621)
at
o.a.i.i.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.invoke(GridCacheOffheapManager.java:1935)
at
o.a.i.i.processors.cache.IgniteCacheOffheapManagerImpl.invoke(IgniteCacheOffheapManagerImpl.java:428)
at
o.a.i.i.processors.cache.GridCacheMapEntry.storeValue(GridCacheMapEntry.java:4248)
at
o.a.i.i.processors.cache.GridCacheMapEntry.initialValue(GridCacheMapEntry.java:3391)
at
o.a.i.i.processors.cache.GridCacheEntryEx.initialValue(GridCacheEntryEx.java:766)
at
o.a.i.i.processors.datastreamer.DataStreamerImpl$IsolatedUpdater.receive(DataStreamerImpl.java:2265)
at
o.a.i.i.processors.datastreamer.DataStreamerUpdateJob.call(DataStreamerUpdateJob.java:140)
at
o.a.i.i.processors.datastreamer.DataStreamProcessor.localUpdate(DataStreamProcessor.java:400)
at
o.a.i.i.processors.datastreamer.DataStreamProcessor.processRequest(DataStreamProcessor.java:305)
at
o.a.i.i.processors.datastreamer.DataStreamProcessor.access$000(DataStreamProcessor.java:60)
at
o.a.i.i.processors.datastreamer.DataStreamProcessor$1.onMessage(DataStreamProcessor.java:90)
at
o.a.i.i.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1569)
at
o.a.i.i.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1197)
at
o.a.i.i.managers.communication.GridIoManager.access$4200(GridIoManager.java:127)
at
o.a.i.i.managers.communication.GridIoManager$9.run(GridIoManager.java:1093)
at
o.a.i.i.util.StripedExecutor$Stripe.body(StripedExecutor.java:505)
at o.a.i.i.util.worker.GridWorker.run(GridWorker.java:120)
at java.lang.Thread.run(Thread.java:748)
As always, you could fix that by increasing failureDetectionTimeout (in
ms). If it does not help please provide full instance log.
Regards,
--
Ilya Kasnacheev
ср, 30 янв. 2019 г. в 13:48, BinaryTree <[email protected]>:
> Hi Igniters -
>
> When I load data from our database, an error occurred:
> 2019-01-30 08:32:45:805 [tcp-disco-msg-worker-#2%ignite-server-003%] ERROR
> o.a.i.i.u.t.G:498 - Blocked system-critical thread has been detected.
> This can lead to cluster-wide undefined behaviour
> [threadName=data-streamer-stripe-2, blockedFor=12s]
> 2019-01-30 08:32:45:805 [tcp-disco-msg-worker-#2%ignite-server-003%] WARN
> o.a.i.i.u.t.G:488 - Thread [name=
> "data-streamer-stripe-2-#11%ignite-server-003%", id=25, state=WAITING,
> blockCnt=0, waitCnt=332764]
>
> then print the thread stacks, I have not see this error before and do not
> know what does it mean clearly.
> I attached the dumped thread file, and wish some can tell me why the error
> occurred.
>
>
>
>
