[GitHub] [spark] turboFei commented on a change in pull request #28525: [SPARK-27562][Shuffle] Complete the verification mechanism for shuffle transmitted data

turboFei commented on a change in pull request #28525: URL: https://github.com/apache/spark/pull/28525#discussion_r428555017 ## File path: common/network-shuffle/src/main/java/org/apache/spark/network/shuffle/ShuffleIndexInformation.java ## @@ -31,17 +34,44 @@ public class

[GitHub] [spark] turboFei commented on a change in pull request #28525: [SPARK-27562][Shuffle] Complete the verification mechanism for shuffle transmitted data

turboFei commented on a change in pull request #28525: URL: https://github.com/apache/spark/pull/28525#discussion_r428495266 ## File path: common/network-common/src/main/java/org/apache/spark/network/util/DigestUtils.java ## @@ -0,0 +1,69 @@ +/* + * Licensed to the Apache

[GitHub] [spark] turboFei commented on a change in pull request #28525: [SPARK-27562][Shuffle] Complete the verification mechanism for shuffle transmitted data

turboFei commented on a change in pull request #28525: URL: https://github.com/apache/spark/pull/28525#discussion_r428490170 ## File path: core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala ## @@ -626,16 +628,61 @@ final class