onebox-li opened a new pull request, #2003: URL: https://github.com/apache/incubator-celeborn/pull/2003
### What changes were proposed in this pull request? Support specifying the number of dispatcher threads for each role, especially shuffle client side. For shuffle client, there is only RpcEndpointVerifier endpoint which handles not many requests, one thread is enough. The rpc env of other roles has only two endpoints at most, using a shared event loop is reasonable. I am not sure if there is a need to add rpc requests to shuffle client. So add specific parameters to specify the dispatcher threads here. And change the dispatcher thread pool name in order to distinguish it from spark's. ### Why are the changes needed? Ditto ### Does this PR introduce _any_ user-facing change? Yes, add params celeborn.rpc.<role>.dispatcher.threads ### How was this patch tested? Manual test and UT -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
