Re: Spark checkpointing

On 7 Jan 2017, at 08:29, Felix Cheung > wrote: Thanks Steve. As you have pointed out, we have seen some issues related to cloud storage as "file system". I'm looking at checkpointing recently. What do you think would be the

Spark checkpointing

Thanks Steve. As you have pointed out, we have seen some issues related to cloud storage as "file system". I'm looking at checkpointing recently. What do you think would be the improvement we could make for "non local" (== reliable?) checkpointing? From: Steve

Spark Checkpointing behavior

Hi, I am trying to understand the behavior of rdd.checkpoint() in Spark. I am running the JavaPageRank example on a 1 GB graph and I am checkpointing the *ranks *rdd inside each