I am using savePairs method of the IgniteRdd with overwrite set to true.
I am hitting the following exception when the loading of data from HDFS to
Ignite is happening.
Here is the snippet of code:
val igniteRDD = igniteContext.fromCache(cacheCfg)
igniteRDD.savePairs(inputRdd, overwrite = true)
Exception:
at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl$5.apply(DataStreamerImpl.java:865)
at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl$5.apply(DataStreamerImpl.java:834)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.notifyListener(GridFutureAdapter.java:382)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.unblock(GridFutureAdapter.java:346)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.unblockAll(GridFutureAdapter.java:334)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:494)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:473)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.onDone(GridFutureAdapter.java:461)
at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl$Buffer.onNodeLeft(DataStreamerImpl.java:1748)
at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl$2$1.run(DataStreamerImpl.java:309)
at
org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:6664)
at
org.apache.ignite.internal.processors.closure.GridClosureProcessor$1.body(GridClosureProcessor.java:817)
at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
... 3 more
Caused by: class
org.apache.ignite.internal.cluster.ClusterTopologyCheckedException: Failed
to wait for request completion (node has left):
0b6e3193-6075-417a-9038-70a66ca3ac86
at
org.apache.ignite.internal.processors.datastreamer.DataStreamerImpl$Buffer.onNodeLeft(DataStreamerImpl.java:1744)
... 7 more
Can someone help me with the above error?
I also increased the failure detection timeout in the IgniteConfiguration by
doing
conf.setClientFailureDetectionTimeout(Long.MaxValue)
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
