RDD's are immutable, so there isn't really such a thing as modifying a block in-place inside of an RDD. As a result, this particular consistency issue doesn't come up in Spark.
- Patrick On Thu, Jan 16, 2014 at 1:42 AM, SaiPrasanna <[email protected]> wrote: > Hello, i am a novice to SPARK > > Say that we have created an RDD1 from native file system/HDFS and done some > transformations and actions and that resulted in an RDD2. Lets assume RDD1 > and RDD2 are persisted, cached in-memory. If the block from where RDD1 was > created was modified at time T1 and RDD1/RDD2 is accessed later at T2 > T1, > is there a way either SPARK ensures consistency or it is upto the programmer > to make it explicit? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Consistency-between-RDD-s-and-Native-File-System-tp583.html > Sent from the Apache Spark User List mailing list archive at Nabble.com.
