Hi, I am trying to load Hdfs data into cache from Spark. it is working in local mode, but failed in spark-submit yarn mode. it tried to find Ignite Home path in the cluster. yes, it is true that Ignite is not installed in cluster. but why needed ? Ignite instance is created inside my java code and all of ignite jars are packaged. why need to find ignite info outside of my jar.

My ignite version is 2.3.

Anyone has a working example of Spark submit + Yarn mode ?  any web link is welcome.

Thanks. Edward

Reply via email to