TheodoreLx opened a new pull request, #3394: URL: https://github.com/apache/celeborn/pull/3394
### What changes were proposed in this pull request? Apply for a byte array in advance and use it as a transfer when copying is needed during flush ### Why are the changes needed? For HdfsFlushTask, OssFlushTask, and S3FlushTask, you need to copy the CompositeByteBuf in the parameter to a byte array when flushing, and then use the respective clients to write the byte array to the storage. When the flush throughput rate is very high, this copying will cause very serious GC problems and affect the performance of the worker ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? cluster test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
