How to safely shut down an app with shared RDD without lossing data?

[baozipu]

Hello, 

I wrote two spark + ignite app, with shared RDD. 

*The first Application app1, create the Shared RDD and savePairs 1:100: *

    val sharedRDD: IgniteRDD[Int, Int] = igniteContext.fromCache[Int,
Int]("sharedRDD")

    sharedRDD.savePairs(ss.sparkContext.parallelize(1 to 100, 64).map(i =>
(i, i)))


*The second application app2, get the Shared RDD and save Pairs 101:200:*

    val cacheRDD: IgniteRDD[Int, Int] = igniteContext.fromCache[Int,
Int]("sharedRDD")
   
    cacheRDD.savePairs(ss.sparkContext.parallelize(101 to 200, 64).map(i =>
(i, i)))


Now, after the app2 saved the pairs,  I want the app2 shut down itself.

I would like to know, after the app2 exits, if app1 holds all the values
from 1:200? 

is there any potential data loss? How to prevent it? Launching app2 as a
client instead of server? 






--
View this message in context: 
http://apache-ignite-users.70518.x6.nabble.com/How-to-safely-shut-down-an-app-with-shared-RDD-without-lossing-data-tp13012.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.