xumingming commented on code in PR #3716:
URL: https://github.com/apache/celeborn/pull/3716#discussion_r3348720176
##########
client/src/main/java/org/apache/celeborn/client/ShuffleClient.java:
##########
@@ -188,6 +225,73 @@ public abstract int pushData(
int numPartitions)
throws IOException;
+ /**
+ * Pre-compute CRC for a batch immediately after assembly in the writer,
before the data enters
+ * the async push pipeline. This is the sole CRC accumulation path when
shuffle integrity check is
+ * enabled.
+ */
+ public abstract void computeBatchCRC(
Review Comment:
I'd be glad to add the cpp implementation of CRC interfaces in a future PR.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
