[
https://issues.apache.org/jira/browse/IGNITE-12397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shenson Joseph updated IGNITE-12397:
------------------------------------
Reviewer: Alexey Zinoviev
> Apache spark - org.apache.ignite.IgniteIllegalStateException
> ------------------------------------------------------------
>
> Key: IGNITE-12397
> URL: https://issues.apache.org/jira/browse/IGNITE-12397
> Project: Ignite
> Issue Type: Bug
> Components: spark
> Affects Versions: 2.7
> Reporter: Shenson Joseph
> Priority: Blocker
>
> Running spark application with apache ignite-2.7.0 throws following exception
> This causes spark applications to die.Do we have a work around for this
> problem
> 9/11/26 16:38:50 INFO CoarseGrainedExecutorBackend: Got assigned task
> 1568109/11/26 16:38:50 INFO CoarseGrainedExecutorBackend: Got assigned task
> 15681019/11/26 16:38:50 INFO Executor: Running task 0.2 in stage 1564.0 (TID
> 156810)19/11/26 16:38:50 ERROR Executor: Exception in task 0.2 in stage
> 1564.0 (TID 156810)class org.apache.ignite.IgniteIllegalStateException:
> Ignite instance with provided name doesn't exist. Did you call
> Ignition.start(..) to start an Ignite instance? [name=shared-grid] at
> org.apache.ignite.internal.IgnitionEx.grid(IgnitionEx.java:1390) at
> org.apache.ignite.Ignition.ignite(Ignition.java:531) at
> org.apache.ignite.spark.impl.package$.ignite(package.scala:86) at
> org.apache.ignite.spark.impl.IgniteRelationProvider$$anonfun$configProvider$1$2.apply(IgniteRelationProvider.scala:226)
> at
> org.apache.ignite.spark.impl.IgniteRelationProvider$$anonfun$configProvider$1$2.apply(IgniteRelationProvider.scala:223)
> at org.apache.ignite.spark.Once.apply(IgniteContext.scala:224) at
> org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:145) at
> org.apache.ignite.spark.impl.IgniteSQLDataFrameRDD.compute(IgniteSQLDataFrameRDD.scala:65)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at
> org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at
> org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at
> org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at
> org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at
> org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at
> org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at
> org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at
> org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at
> org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at
> org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99) at
> org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:55) at
> org.apache.spark.scheduler.Task.run(Task.scala:123) at
> org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408)
> at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) at
> org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)19/11/26 16:38:50 INFO
> CoarseGrainedExecutorBackend: Got assigned task 15681119/11/26 16:38:50 INFO
> Executor: Running task 0.3 in stage 1562.0 (TID 156811)19/11/26 16:38:50
> ERROR Executor: Exception in task 0.3 in stage 1562.0 (TID 156811)class
> org.apache.ignite.IgniteIllegalStateException: Ignite instance with provided
> name doesn't exist.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)