viirya commented on issue #25856: [SPARK-29182][Core] Cache preferred locations of checkpointed RDD URL: https://github.com/apache/spark/pull/25856#issuecomment-536069429 > Is there any guess about how often the correct location would change? is it quite exceptional, or common? I do not have statistic number for this. The correct location changes when blocks on DFS are corrupted and DFS tries to create new replicas on new host. I guess it is not say quite exceptional, but it should not be frequently happened. This is just my guess, of course.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
