GitHub user neoremind opened a pull request:
https://github.com/apache/spark/pull/18964
[SPARK-21701][CORE] Enable RPC client to use ` SO_RCVBUF` and ` SO_SNDBUF`
in SparkConf.
## What changes were proposed in this pull request?
TCP parameters like SO_RCVBUF and SO_SNDBUF can be set in SparkConf, and
`org.apache.spark.network.server.TransportServe`r can use those parameters to
build server by leveraging netty. But for TransportClientFactory, there is no
such way to set those parameters from SparkConf. This could be inconsistent in
server and client side when people set parameters in SparkConf. So this PR make
RPC client to be enable to use those TCP parameters as well.
## How was this patch tested?
Existing tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/neoremind/spark add_client_param
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/18964.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #18964
----
commit 14ba13b1fec4fbe20b130283ba0d6b2d5c58bb87
Author: xu.zhang <[email protected]>
Date: 2017-08-16T14:30:25Z
Enable RPC client to use ` SO_RCVBUF` and ` SO_SNDBUF` in SparkConf.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
