reswqa commented on PR #2662: URL: https://github.com/apache/celeborn/pull/2662#issuecomment-2277018189
Hi @RexXiong, > For the Flink 1.20 release, please specify the main upgrade features and any incompatible changes for integrating with Remote shuffle service. 1.20 was the last non-bug-fix release of before Flink 2.0, you can found all main upgrade feature in this [blog post](https://nightlies.apache.org/flink/flink-docs-release-1.20/release-notes/flink-1.20/). I think the most important feature related to Celeborn is we expose some interface to support Flink hybrid shuffle integration with Celeborn([FLIP-459](https://cwiki.apache.org/confluence/display/FLINK/FLIP-459%3A+Support+Flink+hybrid+shuffle+integration+with+Apache+Celeborn)). This(supporting hybrid shuffle in Celeborn side) is also a follow-up stuff to this PR. incompatible changes: - 1.20 use enum `CompressionCodec` instead of `String` to construct `BufferDecompressor` and `BufferCompressor`. - 1.20 introduce a new method(`notifyPartitionRecoveryStarted`) to `JobShuffleContext` in a non-compatible way. I've already done the adaptation in this PR. > Additionally, update the docs/README.md file to include instructions for integrating Celeborn with Flink 1.20. Updated now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
