saurabhd336 opened a new pull request, #3593: URL: https://github.com/apache/celeborn/pull/3593
### What changes were proposed in this pull request? During openStream calls to workers, the worker netty threads can get blocked for `sortTimeout` milliseconds. This could degrade other worker RPC calls. Ideally, if we introduce an async reply mechanism, we can free the netty threads thereby ensuring other RPC calls are not impacted. ### Why are the changes needed? Avoid blocking worker netty threads during heavy sorting openStream calls. ### Does this PR resolve a correctness bug? No ### Does this PR introduce _any_ user-facing change? Set worker config "celeborn.worker.async.openStream.enabled" to move to async reply mechanism for openStream calls. ### How was this patch tested? TODO -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
