[GitHub] [spark] duanmeng commented on a change in pull request #28525: [SPARK-27562][Shuffle] Complete the verification mechanism for shuffle transmitted data

2020-05-20 Thread GitBox
duanmeng commented on a change in pull request #28525: URL: https://github.com/apache/spark/pull/28525#discussion_r428428247 ## File path: core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala ## @@ -626,16 +628,61 @@ final class

[GitHub] [spark] duanmeng commented on a change in pull request #28525: [SPARK-27562][Shuffle] Complete the verification mechanism for shuffle transmitted data

2020-05-20 Thread GitBox
duanmeng commented on a change in pull request #28525: URL: https://github.com/apache/spark/pull/28525#discussion_r428427803 ## File path: core/src/main/scala/org/apache/spark/shuffle/IndexShuffleBlockResolver.scala ## @@ -170,11 +190,38 @@ private[spark] class