SteNicholas opened a new pull request, #3518: URL: https://github.com/apache/celeborn/pull/3518
### What changes were proposed in this pull request? Support native kqueue transport on BSD/MacOS for `celeborn.<module>.io.mode`. Backport: - https://github.com/apache/spark/pull/52703 - https://github.com/apache/spark/pull/52724 ### Why are the changes needed? Netty provides the following platform specific JNI transports for (native transports)[https://netty.io/wiki/native-transports.html]: - Linux (since 4.0.16) - MacOS/BSD (since 4.1.11) These JNI transports add features specific to a particular platform, generate less garbage, and generally improve performance when compared to the NIO based transport. ### Does this PR introduce _any_ user-facing change? Change the default value of `celeborn.<module>.io.mode` from `NIO` to `EPOLL` if epoll mode is available, from `NIO` to `KQUEUE` if kqueue mode is available, falling back to `NIO` otherwise. ### How was this patch tested? CI. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
