Hi, @seyeony! There was a bug with MySQL dialect and large datasets fixed recently in master. By default MySQL JDBC driver load all rows of result set to memory and that may result in OOME and node left the grid. Or try to give more memory to node (if it possible).
Could you try with latest nightly build? https://ignite.apache.org/community/contribute.html#nightly-builds See org.apache.ignite.cache.store.jdbc.dialect.MySQLDialect#getFetchSize() method. You may need to implement your own dialect for MariaDB or try to use MySQLDialect. On Tue, Sep 6, 2016 at 3:41 PM, seyeony <[email protected]> wrote: > Hi, > I finally succeed to run the demo program from examples with MariaDB. > I thank you very much for your valuable comments. > I changed the Person object to bigger object AffiliateStore for the real > test. > I tested about 5.8 millions of data stored in my MariaDB. > After a while, I got the following messages: > I don't know what kind of error it is and what I did wrong. > Please could someone advise me on this error? > When I tested with about 20,000 records of data, there was no problem... > Thank you. > > - sy > ==================================== > >>> Loading entries from database. > [17:24:08] Topology snapshot [ver=5, servers=2, clients=1, CPUs=8, > heap=10.0GB] > [17:24:09,133][SEVERE][pub-#54%null%][GridTaskWorker] Failed to obtain > remote job result policy for result from ComputeTask.result(..) method > (will > fail the whole task): GridJobResultImpl [job=C2V2 [c=LoadCacheJobV2 > [keepBinary=false]], sib=GridJobSiblingImpl > [sesId=213a59ef651-ee90c020-3934-467b-8020-e98b0eb3ae65, > jobId=413a59ef651-ee90c020-3934-467b-8020-e98b0eb3ae65, > nodeId=2b62514e-dbdf-4aaf-890e-e362c2528e5d, isJobDone=false], > jobCtx=GridJobContextImpl > [jobId=413a59ef651-ee90c020-3934-467b-8020-e98b0eb3ae65, timeoutObj=null, > attrs={}], node=TcpDiscoveryNode [id=2b62514e-dbdf-4aaf-890e-e362c2528e5d, > addrs=[0:0:0:0:0:0:0:1%lo, 10.20.53.0, 10.20.53.1, 127.0.0.1, > 192.168.10.58, > 192.168.122.1], sockAddrs=[/10.20.53.0:47500, /10.20.53.1:47500, > /192.168.122.1:47500, /0:0:0:0:0:0:0:1%lo:47500, /127.0.0.1:47500, > ecube58/192.168.10.58:47500], discPort=47500, order=2, intOrder=2, > lastExchangeTime=1473150035952, loc=false, ver=1.7.0#20160802-sha1: > 383273e3, > isClient=false], ex=class o.a.i.cluster.ClusterTopologyException: Node has > left grid: 2b62514e-dbdf-4aaf-890e-e362c2528e5d, hasRes=true, > isCancelled=false, isOccupied=true] > class org.apache.ignite.cluster.ClusterTopologyException: Node has left > grid: 2b62514e-dbdf-4aaf-890e-e362c2528e5d > at > org.apache.ignite.internal.processors.task.GridTaskWorker.onNodeLeft( > GridTaskWorker.java:1356) > at > org.apache.ignite.internal.processors.task.GridTaskProcessor$ > TaskDiscoveryListener$1.run(GridTaskProcessor.java:1247) > at > org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils. > java:6577) > at > org.apache.ignite.internal.processors.closure.GridClosureProcessor$1.body( > GridClosureProcessor.java:781) > at > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) > at > java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > [17:24:09] (err) Failed to execute compound future reducer: > GridCompoundFuture [rdc=null, initFlag=1, lsnrCalls=0, done=false, > cancelled=false, err=null, futs=[true]]class > org.apache.ignite.IgniteCheckedException: Node has left grid: > 2b62514e-dbdf-4aaf-890e-e362c2528e5d > at org.apache.ignite.internal.util.IgniteUtils.cast( > IgniteUtils.java:7142) > at > org.apache.ignite.internal.util.future.GridFutureAdapter. > get0(GridFutureAdapter.java:168) > at > org.apache.ignite.internal.util.future.GridFutureAdapter. > get(GridFutureAdapter.java:117) > at > org.apache.ignite.internal.util.future.GridCompoundFuture.apply( > GridCompoundFuture.java:88) > at > org.apache.ignite.internal.util.future.GridCompoundFuture.apply( > GridCompoundFuture.java:41) > at > org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener( > GridFutureAdapter.java:263) > at > org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListeners( > GridFutureAdapter.java:251) > at > org.apache.ignite.internal.util.future.GridFutureAdapter. > onDone(GridFutureAdapter.java:381) > at > org.apache.ignite.internal.util.future.GridFutureAdapter. > onDone(GridFutureAdapter.java:347) > at > org.apache.ignite.internal.processors.task.GridTaskWorker.finishTask( > GridTaskWorker.java:1475) > at > org.apache.ignite.internal.processors.task.GridTaskWorker.finishTask( > GridTaskWorker.java:1443) > at > org.apache.ignite.internal.processors.task.GridTaskWorker$4.apply( > GridTaskWorker.java:988) > at > org.apache.ignite.internal.processors.task.GridTaskWorker$4.apply( > GridTaskWorker.java:939) > at > org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils. > java:6553) > at > org.apache.ignite.internal.processors.task.GridTaskWorker.result( > GridTaskWorker.java:939) > at > org.apache.ignite.internal.processors.task.GridTaskWorker.onResponse( > GridTaskWorker.java:810) > at > org.apache.ignite.internal.processors.task.GridTaskWorker.onNodeLeft( > GridTaskWorker.java:1375) > at > org.apache.ignite.internal.processors.task.GridTaskProcessor$ > TaskDiscoveryListener$1.run(GridTaskProcessor.java:1247) > at > org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils. > java:6577) > at > org.apache.ignite.internal.processors.closure.GridClosureProcessor$1.body( > GridClosureProcessor.java:781) > at > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) > at > java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: class org.apache.ignite.cluster.ClusterTopologyException: Node > has left grid: 2b62514e-dbdf-4aaf-890e-e362c2528e5d > at > org.apache.ignite.internal.processors.task.GridTaskWorker.onNodeLeft( > GridTaskWorker.java:1356) > ... 7 more > [17:24:09] Ignite node stopped OK [uptime=00:03:32:980] > Exception in thread "main" javax.cache.CacheException: class > org.apache.ignite.IgniteCheckedException: Node has left grid: > 2b62514e-dbdf-4aaf-890e-e362c2528e5d > at > org.apache.ignite.internal.processors.cache.GridCacheUtils. > convertToCacheException(GridCacheUtils.java:1502) > at > org.apache.ignite.internal.processors.cache.IgniteCacheProxy. > cacheException(IgniteCacheProxy.java:2021) > at > org.apache.ignite.internal.processors.cache.IgniteCacheProxy.loadCache( > IgniteCacheProxy.java:393) > at demo.Demo.preload(Demo.java:87) > at demo.Demo.main(Demo.java:64) > Caused by: class org.apache.ignite.IgniteCheckedException: Node has left > grid: 2b62514e-dbdf-4aaf-890e-e362c2528e5d > at org.apache.ignite.internal.util.IgniteUtils.cast( > IgniteUtils.java:7142) > at > org.apache.ignite.internal.util.future.GridFutureAdapter. > get0(GridFutureAdapter.java:168) > at > org.apache.ignite.internal.util.future.GridFutureAdapter. > get(GridFutureAdapter.java:117) > at > org.apache.ignite.internal.util.future.GridCompoundFuture.apply( > GridCompoundFuture.java:88) > at > org.apache.ignite.internal.util.future.GridCompoundFuture.apply( > GridCompoundFuture.java:41) > at > org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener( > GridFutureAdapter.java:263) > at > org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListeners( > GridFutureAdapter.java:251) > at > org.apache.ignite.internal.util.future.GridFutureAdapter. > onDone(GridFutureAdapter.java:381) > at > org.apache.ignite.internal.util.future.GridFutureAdapter. > onDone(GridFutureAdapter.java:347) > at > org.apache.ignite.internal.processors.task.GridTaskWorker.finishTask( > GridTaskWorker.java:1475) > at > org.apache.ignite.internal.processors.task.GridTaskWorker.finishTask( > GridTaskWorker.java:1443) > at > org.apache.ignite.internal.processors.task.GridTaskWorker$4.apply( > GridTaskWorker.java:988) > at > org.apache.ignite.internal.processors.task.GridTaskWorker$4.apply( > GridTaskWorker.java:939) > at > org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils. > java:6553) > at > org.apache.ignite.internal.processors.task.GridTaskWorker.result( > GridTaskWorker.java:939) > at > org.apache.ignite.internal.processors.task.GridTaskWorker.onResponse( > GridTaskWorker.java:810) > at > org.apache.ignite.internal.processors.task.GridTaskWorker.onNodeLeft( > GridTaskWorker.java:1375) > at > org.apache.ignite.internal.processors.task.GridTaskProcessor$ > TaskDiscoveryListener$1.run(GridTaskProcessor.java:1247) > at > org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils. > java:6577) > at > org.apache.ignite.internal.processors.closure.GridClosureProcessor$1.body( > GridClosureProcessor.java:781) > at > org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110) > at > java.util.concurrent.ThreadPoolExecutor.runWorker( > ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run( > ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:745) > Caused by: class org.apache.ignite.cluster.ClusterTopologyException: Node > has left grid: 2b62514e-dbdf-4aaf-890e-e362c2528e5d > at > org.apache.ignite.internal.processors.task.GridTaskWorker.onNodeLeft( > GridTaskWorker.java:1356) > ... 7 more > ==================================== > > > > -- > View this message in context: http://apache-ignite-users. > 70518.x6.nabble.com/CacheJdbcPojoStore-with-MariaDB-tp7538.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. > -- Alexey Kuznetsov GridGain Systems www.gridgain.com
