[GitHub] [spark] viirya commented on a change in pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

viirya commented on a change in pull request #28708: URL: https://github.com/apache/spark/pull/28708#discussion_r435522183 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManager.scala ## @@ -1790,6 +1822,108 @@ private[spark] class BlockManager( } } +

[GitHub] [spark] viirya commented on a change in pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

viirya commented on a change in pull request #28708: URL: https://github.com/apache/spark/pull/28708#discussion_r435522183 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManager.scala ## @@ -1790,6 +1822,108 @@ private[spark] class BlockManager( } } +

[GitHub] [spark] viirya commented on a change in pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

viirya commented on a change in pull request #28708: URL: https://github.com/apache/spark/pull/28708#discussion_r435508884 ## File path: core/src/main/scala/org/apache/spark/storage/BlockManager.scala ## @@ -1907,23 +2041,39 @@ private[spark] class BlockManager( */ priva

[GitHub] [spark] viirya commented on a change in pull request #28708: [SPARK-20629][CORE][K8S] Copy shuffle data when nodes are being shutdown

viirya commented on a change in pull request #28708: URL: https://github.com/apache/spark/pull/28708#discussion_r435438297 ## File path: core/src/main/scala/org/apache/spark/SparkContext.scala ## @@ -1725,6 +1725,16 @@ class SparkContext(config: SparkConf) extends Logging {