Hello!
I'm afraid you will have to increase amount of heap available to your nodes
if you have 1M blob columns.
Yes, it should be all right.
Regards,
--
Ilya Kasnacheev
пн, 10 июн. 2019 г. в 20:15, Shane Duan <sduane...@gmail.com>:
> Thanks, Ilya. I tried the lazy=true, still no luck. We also tried a
> different test workflow, in which, there is a table contains about 1000
> rows; each rows has id column(primary key), 3 string columns and a blob
> column (about 1M each). Then we have a multithread application(using Tomcat
> thread pool) which will perform queries (where id=<some random id>). Ignite
> crashes with this application as well(out of memory). If the WHERE clause
> is identical (all with same id), no problem.
>
> By the way, is it okay to use Ignite JDC driver with Tomcat thread pool?
>
>
>
> On Fri, Jun 7, 2019 at 9:25 AM Ilya Kasnacheev <ilya.kasnach...@gmail.com>
> wrote:
>
> > Hello!
> >
> > Consider adding ;lazy=true to connection string. You're causing overly
> huge
> > result set to be held on heap otherwise.
> >
> > Regards,
> > --
> > Ilya Kasnacheev
> >
> >
> > пт, 7 июн. 2019 г. в 19:07, Shane Duan <sduane...@gmail.com>:
> >
> > > Thanks Denis.
> > >
> > > Oops, copied wrong section of log file. The previous log which
> complains
> > > schema will happen for any further operations once Ignite crashed.
> > >
> > > Here is how I prepared the JDBC connection:
> > >
> > > String connectionStr = "jdbc:ignite:thin://" + hostName + ":" +
> > portNumber
> > > +";"
> > > + "schema=" + schema + ";"
> > > + "user=" + userName + ";"
> > > + "password=" + password;
> > >
> > > // Register JDBC driver.
> > > Class.forName("org.apache.ignite.IgniteJdbcThinDriver");
> > >
> > > // Open the JDBC connection with predefined connection endpoints.
> > > Connection conn = DriverManager.getConnection(connectionStr);
> > >
> > >
> > > The example works if just fetch a couple of rows.
> > >
> > > Here is the right log.
> > >
> > >
> > > 2019-06-06 10:42:34,402 DEBUG Client request received [reqId=0, addr=/
> > > 10.212.22.67:54469, req=JdbcQueryExecuteRequest
> > > [schemaName=FEATURE_TILE_CACHE, pageSize=1024, maxRows=0, sqlQry=SELECT
> > id,
> > > val FROM CITY WHERE id > 500, args=[], stmtType=SELECT_STATEMENT_TYPE,
> > > autoCommit=true]]
> > > 2019-06-06 10:42:34,407 DEBUG Set schema: FEATURE_TILE_CACHE
> > > 2019-06-06 10:42:34,448 DEBUG Parsed query: `SELECT id, val FROM CITY
> > WHERE
> > > id > 500` into two step query: GridCacheTwoStepQuery
> > > [mapQrys=[GridCacheSqlQuery [qry=SELECT
> > > __Z0.ID __C0_0,
> > > __Z0.VAL __C0_1
> > > FROM FEATURE_TILE_CACHE.CITY __Z0
> > > WHERE __Z0.ID > 500, paramIdxs=[], cols={__C0_0=GridSqlType [type=5,
> > > scale=0, precision=19, displaySize=20, sql=BIGINT], __C0_1=GridSqlType
> > > [type=12, scale=0, precision=2147483647, displaySize=2147483647,
> > > sql=VARBINARY]}, alias=null, sort=[], partitioned=true, node=null,
> > > derivedPartitions=null, hasSubQries=false]], rdc=GridCacheSqlQuery
> > > [qry=SELECT
> > > __C0_0 ID,
> > > __C0_1 VAL
> > > FROM PUBLIC.__T0, paramIdxs=[], cols=null, alias=null, sort=null,
> > > partitioned=false, node=null, derivedPartitions=null,
> hasSubQries=false],
> > > pageSize=1024, explain=false, originalSql=SELECT
> > > ID,
> > > VAL
> > > FROM FEATURE_TILE_CACHE.CITY
> > > WHERE ID > 500, distributedJoins=false, skipMergeTbl=true, local=false,
> > > mvccEnabled=false, forUpdate=false]
> > > 2019-06-06 10:42:34,448 DEBUG Parsed query: `SELECT id, val FROM CITY
> > WHERE
> > > id > 500` into two step query: GridCacheTwoStepQuery
> > > [mapQrys=[GridCacheSqlQuery [qry=SELECT
> > > __Z0.ID __C0_0,
> > > __Z0.VAL __C0_1
> > > FROM FEATURE_TILE_CACHE.CITY __Z0
> > > WHERE __Z0.ID > 500, paramIdxs=[], cols={__C0_0=GridSqlType [type=5,
> > > scale=0, precision=19, displaySize=20, sql=BIGINT], __C0_1=GridSqlType
> > > [type=12, scale=0, precision=2147483647, displaySize=2147483647,
> > > sql=VARBINARY]}, alias=null, sort=[], partitioned=true, node=null,
> > > derivedPartitions=null, hasSubQries=false]], rdc=GridCacheSqlQuery
> > > [qry=SELECT
> > > __C0_0 ID,
> > > __C0_1 VAL
> > > FROM PUBLIC.__T0, paramIdxs=[], cols=null, alias=null, sort=null,
> > > partitioned=false, node=null, derivedPartitions=null,
> hasSubQries=false],
> > > pageSize=1024, explain=false, originalSql=SELECT
> > > ID,
> > > VAL
> > > FROM FEATURE_TILE_CACHE.CITY
> > > WHERE ID > 500, distributedJoins=false, skipMergeTbl=true, local=false,
> > > mvccEnabled=false, forUpdate=false]
> > > 2019-06-06 10:42:34,457 DEBUG Sending: [msg=GridH2QueryRequest
> [reqId=1,
> > > caches=[-2013421729], topVer=AffinityTopologyVersion [topVer=1,
> > > minorTopVer=2], parts=null, qryParts=null, pageSize=1024,
> > > qrys=[GridCacheSqlQuery [qry=SELECT
> > > __Z0.ID __C0_0,
> > > __Z0.VAL __C0_1
> > > FROM FEATURE_TILE_CACHE.CITY __Z0
> > > WHERE __Z0.ID > 500, paramIdxs=[], cols={__C0_0=GridSqlType [type=5,
> > > scale=0, precision=19, displaySize=20, sql=BIGINT], __C0_1=GridSqlType
> > > [type=12, scale=0, precision=2147483647, displaySize=2147483647,
> > > sql=VARBINARY]}, alias=null, sort=[], partitioned=true, node=null,
> > > derivedPartitions=null, hasSubQries=false]], flags=2, tbls=null,
> > timeout=0,
> > > params=[], schemaName=FEATURE_TILE_CACHE, mvccSnapshot=null,
> txReq=null],
> > > nodes=[TcpDiscoveryNode [id=9f8714ae-d9ba-4135-836c-ca8c2a1cc4c1,
> > > addrs=[0:0:0:0:0:0:0:1%lo, 10.29.77.101, 127.0.0.1, 172.17.0.1],
> > > sockAddrs=[/172.17.0.1:9820, greentea.esri.com/10.29.77.101:9820,
> > > /0:0:0:0:0:0:0:1%lo:9820, /127.0.0.1:9820], discPort=9820, order=1,
> > > intOrder=1, lastExchangeTime=1559842863817, loc=true,
> > > ver=2.7.0#20181130-sha1:256ae401, isClient=false]], specialize=null]
> > > 2019-06-06 10:42:34,463 DEBUG Getting internal cache adapter:
> > > SQL_FEATURE_TILE_CACHE_CITY
> > > 2019-06-06 10:42:34,644 DEBUG Balancing data [min0=0, minIdx=0,
> max0=-1,
> > > maxIdx=-1]
> > > 2019-06-06 10:42:35,195 DEBUG Balancing data [min0=0, minIdx=0,
> max0=-1,
> > > maxIdx=-1]
> > > 2019-06-06 10:42:35,642 DEBUG Timeout has occurred [obj=CancelableTask
> > > [id=a3531ed2b61-03a278bc-9575-4d0a-932a-cd5848a66225,
> > > endTime=1559842955633, period=2000, cancel=false,
> > >
> > >
> >
> task=org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing$13@3ee9d374
> > > ],
> > > process=true]
> > > 2019-06-06 10:42:35,669 DEBUG Balancing data [min0=0, minIdx=0,
> max0=-1,
> > > maxIdx=-1]
> > > 2019-06-06 10:42:36,634 DEBUG Timeout has occurred [obj=CancelableTask
> > > [id=b3531ed2b61-03a278bc-9575-4d0a-932a-cd5848a66225,
> > > endTime=1559842956623, period=3000, cancel=false,
> > >
> > >
> >
> task=org.apache.ignite.internal.processors.query.GridQueryProcessor$2@1cd33664
> > > ],
> > > process=true]
> > > 2019-06-06 10:42:36,916 DEBUG Timeout has occurred [obj=CancelableTask
> > > [id=e3531ed2b61-03a278bc-9575-4d0a-932a-cd5848a66225,
> > > endTime=1559842956906, period=3000, cancel=false, task=MetricsUpdater
> > > [prevGcTime=4, prevCpuTime=-1,
> > >
> > >
> >
> super=org.apache.ignite.internal.managers.discovery.GridDiscoveryManager$MetricsUpdater@466463bb
> > > ]],
> > > process=true]
> > > 2019-06-06 10:42:37,491 DEBUG Timeout has occurred [obj=CancelableTask
> > > [id=d6531ed2b61-03a278bc-9575-4d0a-932a-cd5848a66225,
> > > endTime=1559842957481, period=5000, cancel=false,
> > >
> > >
> >
> task=org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryManager$BackupCleaner@3dc776a3
> > > ],
> > > process=true]
> > > 2019-06-06 10:42:37,644 DEBUG Timeout has occurred [obj=CancelableTask
> > > [id=a3531ed2b61-03a278bc-9575-4d0a-932a-cd5848a66225,
> > > endTime=1559842957639, period=2000, cancel=false,
> > >
> > >
> >
> task=org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing$13@3ee9d374
> > > ],
> > > process=true]
> > > 2019-06-06 10:42:39,022 WARN Page replacements started, pages will be
> > > rotated with disk, this will affect storage performance (consider
> > > increasing DataRegionConfiguration#setMaxSize).
> > > 2019-06-06 10:42:39,230 ERROR Failed to execute local query.
> > > org.apache.ignite.IgniteCheckedException: Failed to execute SQL query.
> > Out
> > > of memory.; SQL statement:
> > > SELECT
> > > __Z0.ID __C0_0,
> > > __Z0.VAL __C0_1
> > > FROM FEATURE_TILE_CACHE.CITY __Z0
> > > WHERE __Z0.ID > 500 [90108-197]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing.executeSqlQuery(IgniteH2Indexing.java:1428)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing.executeSqlQueryWithTimer(IgniteH2Indexing.java:1489)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridMapQueryExecutor.onQueryRequest0(GridMapQueryExecutor.java:930)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridMapQueryExecutor.onQueryRequest(GridMapQueryExecutor.java:705)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridMapQueryExecutor.onMessage(GridMapQueryExecutor.java:240)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor$1.applyx(GridReduceQueryExecutor.java:170)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor$1.applyx(GridReduceQueryExecutor.java:168)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.lang.IgniteInClosure2X.apply(IgniteInClosure2X.java:38)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing.send(IgniteH2Indexing.java:3399)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor.send(GridReduceQueryExecutor.java:1642)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor.query(GridReduceQueryExecutor.java:876)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing$8.iterator(IgniteH2Indexing.java:1803)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.QueryCursorImpl.iterator(QueryCursorImpl.java:95)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.jdbc.JdbcQueryCursor.<init>(JdbcQueryCursor.java:61)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.jdbc.JdbcRequestHandler.executeQuery(JdbcRequestHandler.java:528)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.jdbc.JdbcRequestHandler.doHandle(JdbcRequestHandler.java:245)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.jdbc.JdbcRequestHandler.handle(JdbcRequestHandler.java:208)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.ClientListenerNioListener.onMessage(ClientListenerNioListener.java:162)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.ClientListenerNioListener.onMessage(ClientListenerNioListener.java:45)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.nio.GridNioFilterChain$TailFilter.onMessageReceived(GridNioFilterChain.java:279)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.nio.GridNioAsyncNotifyFilter$3.body(GridNioAsyncNotifyFilter.java:97)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> >
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.worker.GridWorkerPool$1.run(GridWorkerPool.java:70)
> > > [ignite-core.jar:2.7.0]
> > > at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
> > [?:?]
> > > at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> > [?:?]
> > > at java.lang.Thread.run(Unknown Source) [?:?]
> > > Caused by: org.h2.jdbc.JdbcSQLException: Out of memory.; SQL statement:
> > > SELECT
> > > __Z0.ID __C0_0,
> > > __Z0.VAL __C0_1
> > > FROM FEATURE_TILE_CACHE.CITY __Z0
> > > WHERE __Z0.ID > 500 [90108-197]
> > > at org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
> > > ~[h2.jar:1.4.197]
> > > at org.h2.message.DbException.get(DbException.java:168)
> ~[h2.jar:1.4.197]
> > > at org.h2.message.DbException.convert(DbException.java:301)
> > > ~[h2.jar:1.4.197]
> > > at org.h2.command.Command.executeQuery(Command.java:214)
> > ~[h2.jar:1.4.197]
> > > at
> > >
> > >
> >
> org.h2.jdbc.JdbcPreparedStatement.executeQuery(JdbcPreparedStatement.java:114)
> > > ~[h2.jar:1.4.197]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.PreparedStatementExImpl.executeQuery(PreparedStatementExImpl.java:67)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing.executeSqlQuery(IgniteH2Indexing.java:1421)
> > > ~[ignite-indexing.jar:2.7.0]
> > > ... 26 more
> > > Caused by: java.lang.OutOfMemoryError: Java heap space
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.IncompleteCacheObject.<init>(IncompleteCacheObject.java:44)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cacheobject.IgniteCacheObjectProcessorImpl.toCacheObject(IgniteCacheObjectProcessorImpl.java:191)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.CacheDataRowAdapter.readIncompleteValue(CacheDataRowAdapter.java:438)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.CacheDataRowAdapter.readFragment(CacheDataRowAdapter.java:277)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.CacheDataRowAdapter.initFromLink(CacheDataRowAdapter.java:191)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.CacheDataRowAdapter.initFromLink(CacheDataRowAdapter.java:108)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.database.H2RowFactory.getRow(H2RowFactory.java:62)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.database.H2Tree.createRowFromLink(H2Tree.java:217)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.database.io.AbstractH2ExtrasLeafIO.getLookupRow(AbstractH2ExtrasLeafIO.java:154)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.database.io.AbstractH2ExtrasLeafIO.getLookupRow(AbstractH2ExtrasLeafIO.java:36)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.database.H2Tree.getRow(H2Tree.java:248)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.database.H2Tree.getRow(H2Tree.java:55)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$ForwardCursor.fillFromBuffer0(BPlusTree.java:5512)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$AbstractForwardCursor.fillFromBuffer(BPlusTree.java:5280)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$AbstractForwardCursor.init(BPlusTree.java:5205)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$GetCursor.notFound(BPlusTree.java:2899)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Search.run0(BPlusTree.java:306)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$GetPageHandler.run(BPlusTree.java:5615)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Search.run(BPlusTree.java:271)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$GetPageHandler.run(BPlusTree.java:5600)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.readPage(PageHandler.java:159)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.DataStructure.read(DataStructure.java:334)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findDown(BPlusTree.java:1309)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findDown(BPlusTree.java:1318)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.doFind(BPlusTree.java:1276)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.access$8700(BPlusTree.java:90)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$AbstractForwardCursor.find(BPlusTree.java:5289)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1005)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.database.H2TreeIndex.find(H2TreeIndex.java:258)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.opt.GridH2ProxyIndex.find(GridH2ProxyIndex.java:99)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at org.h2.index.BaseIndex.find(BaseIndex.java:130) ~[h2.jar:1.4.197]
> > > at org.h2.index.IndexCursor.find(IndexCursor.java:176)
> ~[h2.jar:1.4.197]
> > > 2019-06-06 10:42:39,273 ERROR Failed to run map query on local node.
> > > org.apache.ignite.IgniteCheckedException: Failed to execute SQL query.
> > Out
> > > of memory.; SQL statement:
> > > SELECT
> > > __Z0.ID __C0_0,
> > > __Z0.VAL __C0_1
> > > FROM FEATURE_TILE_CACHE.CITY __Z0
> > > WHERE __Z0.ID > 500 [90108-197]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing.executeSqlQuery(IgniteH2Indexing.java:1428)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing.executeSqlQueryWithTimer(IgniteH2Indexing.java:1489)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridMapQueryExecutor.onQueryRequest0(GridMapQueryExecutor.java:930)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridMapQueryExecutor.onQueryRequest(GridMapQueryExecutor.java:705)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridMapQueryExecutor.onMessage(GridMapQueryExecutor.java:240)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor$1.applyx(GridReduceQueryExecutor.java:170)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor$1.applyx(GridReduceQueryExecutor.java:168)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.lang.IgniteInClosure2X.apply(IgniteInClosure2X.java:38)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing.send(IgniteH2Indexing.java:3399)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor.send(GridReduceQueryExecutor.java:1642)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor.query(GridReduceQueryExecutor.java:876)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing$8.iterator(IgniteH2Indexing.java:1803)
> > > [ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.QueryCursorImpl.iterator(QueryCursorImpl.java:95)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.jdbc.JdbcQueryCursor.<init>(JdbcQueryCursor.java:61)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.jdbc.JdbcRequestHandler.executeQuery(JdbcRequestHandler.java:528)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.jdbc.JdbcRequestHandler.doHandle(JdbcRequestHandler.java:245)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.jdbc.JdbcRequestHandler.handle(JdbcRequestHandler.java:208)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.ClientListenerNioListener.onMessage(ClientListenerNioListener.java:162)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.ClientListenerNioListener.onMessage(ClientListenerNioListener.java:45)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.nio.GridNioFilterChain$TailFilter.onMessageReceived(GridNioFilterChain.java:279)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.nio.GridNioAsyncNotifyFilter$3.body(GridNioAsyncNotifyFilter.java:97)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> >
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.worker.GridWorkerPool$1.run(GridWorkerPool.java:70)
> > > [ignite-core.jar:2.7.0]
> > > at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
> > [?:?]
> > > at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> > [?:?]
> > > at java.lang.Thread.run(Unknown Source) [?:?]
> > > Caused by: org.h2.jdbc.JdbcSQLException: Out of memory.; SQL statement:
> > > SELECT
> > > __Z0.ID __C0_0,
> > > __Z0.VAL __C0_1
> > > FROM FEATURE_TILE_CACHE.CITY __Z0
> > > WHERE __Z0.ID > 500 [90108-197]
> > > at org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
> > > ~[h2.jar:1.4.197]
> > > at org.h2.message.DbException.get(DbException.java:168)
> ~[h2.jar:1.4.197]
> > > at org.h2.message.DbException.convert(DbException.java:301)
> > > ~[h2.jar:1.4.197]
> > > at org.h2.command.Command.executeQuery(Command.java:214)
> > ~[h2.jar:1.4.197]
> > > at
> > >
> > >
> >
> org.h2.jdbc.JdbcPreparedStatement.executeQuery(JdbcPreparedStatement.java:114)
> > > ~[h2.jar:1.4.197]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.PreparedStatementExImpl.executeQuery(PreparedStatementExImpl.java:67)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing.executeSqlQuery(IgniteH2Indexing.java:1421)
> > > ~[ignite-indexing.jar:2.7.0]
> > > ... 26 more
> > > Caused by: java.lang.OutOfMemoryError: Java heap space
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.IncompleteCacheObject.<init>(IncompleteCacheObject.java:44)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cacheobject.IgniteCacheObjectProcessorImpl.toCacheObject(IgniteCacheObjectProcessorImpl.java:191)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.CacheDataRowAdapter.readIncompleteValue(CacheDataRowAdapter.java:438)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.CacheDataRowAdapter.readFragment(CacheDataRowAdapter.java:277)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.CacheDataRowAdapter.initFromLink(CacheDataRowAdapter.java:191)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.CacheDataRowAdapter.initFromLink(CacheDataRowAdapter.java:108)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.database.H2RowFactory.getRow(H2RowFactory.java:62)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.database.H2Tree.createRowFromLink(H2Tree.java:217)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.database.io.AbstractH2ExtrasLeafIO.getLookupRow(AbstractH2ExtrasLeafIO.java:154)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.database.io.AbstractH2ExtrasLeafIO.getLookupRow(AbstractH2ExtrasLeafIO.java:36)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.database.H2Tree.getRow(H2Tree.java:248)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.database.H2Tree.getRow(H2Tree.java:55)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$ForwardCursor.fillFromBuffer0(BPlusTree.java:5512)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$AbstractForwardCursor.fillFromBuffer(BPlusTree.java:5280)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$AbstractForwardCursor.init(BPlusTree.java:5205)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$GetCursor.notFound(BPlusTree.java:2899)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Search.run0(BPlusTree.java:306)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$GetPageHandler.run(BPlusTree.java:5615)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$Search.run(BPlusTree.java:271)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$GetPageHandler.run(BPlusTree.java:5600)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.util.PageHandler.readPage(PageHandler.java:159)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.DataStructure.read(DataStructure.java:334)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findDown(BPlusTree.java:1309)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.findDown(BPlusTree.java:1318)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.doFind(BPlusTree.java:1276)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.access$8700(BPlusTree.java:90)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree$AbstractForwardCursor.find(BPlusTree.java:5289)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1005)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.database.H2TreeIndex.find(H2TreeIndex.java:258)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.opt.GridH2ProxyIndex.find(GridH2ProxyIndex.java:99)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at org.h2.index.BaseIndex.find(BaseIndex.java:130) ~[h2.jar:1.4.197]
> > > at org.h2.index.IndexCursor.find(IndexCursor.java:176)
> ~[h2.jar:1.4.197]
> > > 2019-06-06 10:42:39,274 DEBUG Timeout has occurred [obj=CancelableTask
> > > [id=b4531ed2b61-03a278bc-9575-4d0a-932a-cd5848a66225,
> > > endTime=1559842959271, period=5000, cancel=false,
> > >
> > >
> >
> task=org.apache.ignite.internal.processors.cache.query.continuous.CacheContinuousQueryManager$BackupCleaner@387c4e36
> > > ],
> > > process=true]
> > > 2019-06-06 10:42:39,275 DEBUG Processed response:
> > >
> >
> 9f8714ae-d9ba-4135-836c-ca8c2a1cc4c1->9f8714ae-d9ba-4135-836c-ca8c2a1cc4c1
> > > GridQueryFailResponse [qryReqId=1, errMsg=Failed to execute SQL query.
> > Out
> > > of memory.; SQL statement:
> > > SELECT
> > > __Z0.ID __C0_0,
> > > __Z0.VAL __C0_1
> > > FROM FEATURE_TILE_CACHE.CITY __Z0
> > > WHERE __Z0.ID > 500 [90108-197], failCode=0]
> > > 2019-06-06 10:42:39,275 DEBUG Processed request:
> > >
> >
> 9f8714ae-d9ba-4135-836c-ca8c2a1cc4c1->9f8714ae-d9ba-4135-836c-ca8c2a1cc4c1
> > > GridH2QueryRequest [reqId=1, caches=[-2013421729],
> > > topVer=AffinityTopologyVersion [topVer=1, minorTopVer=2], parts=null,
> > > qryParts=null, pageSize=1024, qrys=[GridCacheSqlQuery [qry=SELECT
> > > __Z0.ID __C0_0,
> > > __Z0.VAL __C0_1
> > > FROM FEATURE_TILE_CACHE.CITY __Z0
> > > WHERE __Z0.ID > 500, paramIdxs=[], cols={__C0_0=GridSqlType [type=5,
> > > scale=0, precision=19, displaySize=20, sql=BIGINT], __C0_1=GridSqlType
> > > [type=12, scale=0, precision=2147483647, displaySize=2147483647,
> > > sql=VARBINARY]}, alias=null, sort=[], partitioned=true, node=null,
> > > derivedPartitions=null, hasSubQries=false]], flags=2, tbls=null,
> > timeout=0,
> > > params=[], schemaName=FEATURE_TILE_CACHE, mvccSnapshot=null,
> txReq=null]
> > > 2019-06-06 10:42:39,276 DEBUG Sending: [msg=GridQueryCancelRequest
> > > [qryReqId=1], nodes=[TcpDiscoveryNode
> > > [id=9f8714ae-d9ba-4135-836c-ca8c2a1cc4c1, addrs=[0:0:0:0:0:0:0:1%lo,
> > > 10.29.77.101, 127.0.0.1, 172.17.0.1], sockAddrs=[/172.17.0.1:9820,
> > > greentea.esri.com/10.29.77.101:9820, /0:0:0:0:0:0:0:1%lo:9820, /
> > > 127.0.0.1:9820], discPort=9820, order=1, intOrder=1,
> > > lastExchangeTime=1559842863817, loc=true,
> > ver=2.7.0#20181130-sha1:256ae401,
> > > isClient=false]], specialize=null]
> > > 2019-06-06 10:42:39,276 DEBUG Processed request:
> > >
> >
> 9f8714ae-d9ba-4135-836c-ca8c2a1cc4c1->9f8714ae-d9ba-4135-836c-ca8c2a1cc4c1
> > > GridQueryCancelRequest [qryReqId=1]
> > > 2019-06-06 10:42:39,277 ERROR Failed to execute SQL query [reqId=0,
> > > req=JdbcQueryExecuteRequest [schemaName=FEATURE_TILE_CACHE,
> > pageSize=1024,
> > > maxRows=0, sqlQry=SELECT id, val FROM CITY WHERE id > 500, args=[],
> > > stmtType=SELECT_STATEMENT_TYPE, autoCommit=true]]
> > > javax.cache.CacheException: Failed to execute map query on remote node
> > > [nodeId=9f8714ae-d9ba-4135-836c-ca8c2a1cc4c1, errMsg=Failed to execute
> > SQL
> > > query. Out of memory.; SQL statement:
> > > SELECT
> > > __Z0.ID __C0_0,
> > > __Z0.VAL __C0_1
> > > FROM FEATURE_TILE_CACHE.CITY __Z0
> > > WHERE __Z0.ID > 500 [90108-197]]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor.fail(GridReduceQueryExecutor.java:290)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor.onFail(GridReduceQueryExecutor.java:280)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor.onMessage(GridReduceQueryExecutor.java:259)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridMapQueryExecutor.sendError(GridMapQueryExecutor.java:1198)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridMapQueryExecutor.onQueryRequest0(GridMapQueryExecutor.java:1051)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridMapQueryExecutor.onQueryRequest(GridMapQueryExecutor.java:705)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridMapQueryExecutor.onMessage(GridMapQueryExecutor.java:240)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor$1.applyx(GridReduceQueryExecutor.java:170)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor$1.applyx(GridReduceQueryExecutor.java:168)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.lang.IgniteInClosure2X.apply(IgniteInClosure2X.java:38)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing.send(IgniteH2Indexing.java:3399)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor.send(GridReduceQueryExecutor.java:1642)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.twostep.GridReduceQueryExecutor.query(GridReduceQueryExecutor.java:876)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.query.h2.IgniteH2Indexing$8.iterator(IgniteH2Indexing.java:1803)
> > > ~[ignite-indexing.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.cache.QueryCursorImpl.iterator(QueryCursorImpl.java:95)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.jdbc.JdbcQueryCursor.<init>(JdbcQueryCursor.java:61)
> > > ~[ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.jdbc.JdbcRequestHandler.executeQuery(JdbcRequestHandler.java:528)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.jdbc.JdbcRequestHandler.doHandle(JdbcRequestHandler.java:245)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.jdbc.JdbcRequestHandler.handle(JdbcRequestHandler.java:208)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.ClientListenerNioListener.onMessage(ClientListenerNioListener.java:162)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.processors.odbc.ClientListenerNioListener.onMessage(ClientListenerNioListener.java:45)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.nio.GridNioFilterChain$TailFilter.onMessageReceived(GridNioFilterChain.java:279)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.nio.GridNioAsyncNotifyFilter$3.body(GridNioAsyncNotifyFilter.java:97)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> >
> org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120)
> > > [ignite-core.jar:2.7.0]
> > > at
> > >
> > >
> >
> org.apache.ignite.internal.util.worker.GridWorkerPool$1.run(GridWorkerPool.java:70)
> > > [ignite-core.jar:2.7.0]
> > > at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
> > [?:?]
> > > at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
> > [?:?]
> > > at java.lang.Thread.run(Unknown Source) [?:?]
> > > 2019-06-06 10:42:39,277 DEBUG Client request processed [reqId=0,
> > > dur(mcs)=4876231, resp=1]
> > >
> >
>
