turboFei commented on issue #24447: [SPARK-26089] Checking the shuffle transmitted data to handle large corrupt shuffle blocks URL: https://github.com/apache/spark/pull/24447#issuecomment-486476740 > oops, I just noticed you actually used that jira for this change. So clearly if we were going to do this, you should open another jira and explain the case for having a checksum. or also happy to hear if there is some mistake in the change already committed for SPARK-26089: [688b0c0](https://github.com/apache/spark/commit/688b0c01fac0db80f6473181673a89f1ce1be65b) Thanks, I will open another jira and make the case clearly.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
