spark git commit: [SPARK-23524] Big local shuffle blocks should not be checked for corruption.

2018-03-07 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.3 ee6e79737 -> 86ca91551 [SPARK-23524] Big local shuffle blocks should not be checked for corruption. ## What changes were proposed in this pull request? In current code, all local blocks will be checked for corruption no matter it's

spark git commit: [SPARK-23524] Big local shuffle blocks should not be checked for corruption.

2018-03-07 Thread wenchen
Repository: spark Updated Branches: refs/heads/master ac76eff6a -> 77c91cc74 [SPARK-23524] Big local shuffle blocks should not be checked for corruption. ## What changes were proposed in this pull request? In current code, all local blocks will be checked for corruption no matter it's big