Hello, i am a novice to SPARK Say that we have created an RDD1 from native file system/HDFS and done some transformations and actions and that resulted in an RDD2. Lets assume RDD1 and RDD2 are persisted, cached in-memory. If the block from where RDD1 was created was modified at time T1 and RDD1/RDD2 is accessed later at T2 > T1, is there a way either SPARK ensures consistency or it is upto the programmer to make it explicit?
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Consistency-between-RDD-s-and-Native-File-System-tp583.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
