weixiuli commented on PR #36279:
URL: https://github.com/apache/spark/pull/36279#issuecomment-1103712254
Good catching !
It necessary to distinguish the IOException and the
`errorHandler.shouldRetryError`, the `errorHandler.shouldRetryError ` has two
cases need to retry, one is this PR described
`BLOCK_APPEND_COLLISION_MSG_SUFFIX` for pushing, and other is
`STALE_SHUFFLE_BLOCK_FETCH` for fetching . Please add some unittests for them.
also cc @otterc @mridulm
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
