liupc commented on issue #23563: [SPARK-26634]Do not allow task of FetchFailureStage commit in OutputCommitCoordinator URL: https://github.com/apache/spark/pull/23563#issuecomment-463616803 @cloud-fan @vanzin @viirya @HyukjinKwon Sorry, I think this issue is resolved by https://github.com/apache/spark/pull/21131, and this PR allow `markPartitionCompletedInAllTaskSets` which is a better way to fix the issue we encountered in spark2.1, as it improves performance by letting the partition being marked as successful by the first completion attempt.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
