zuston commented on PR #2657: URL: https://github.com/apache/uniffle/pull/2657#issuecomment-3460231276
This PR now logs the number of partition records and blocks written by the upstream writer, which can be compared with the downstream reader using detailed logs if any record count inconsistencies are detected. However, this only identifies issues with the upstream writer or reader. If the problem occurs on the shuffle-server side, this PR will not help. I’m evaluating whether to implement this validation from the perspective of the shuffle-server. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
