For #1, a brief search landed the following:
core/src/main/scala/org/apache/spark/SparkConf.scala:
DeprecatedConfig("spark.rpc", "2.0", "Not used any more.")
core/src/main/scala/org/apache/spark/SparkConf.scala:
"spark.rpc.numRetries" -> Seq(
core/src/main/scala/org/apache/spark/SparkConf.scala:
Thanks Steve!
1. spark-submit submitting the YARN app for launch? That you get it if you
turn hadoop IPC encruption on, by settingo hadoop.rpc.protection=privacy
across the cluster.
> That's what I meant: Is there something similar for stand alone or Mesos?
2. communications between spark driver
> On 1 Feb 2016, at 20:48, eugene miretsky wrote:
>
> Spark supports client authentication via shared secret or kerberos (on YARN).
> However, the job itself is sent unencrypted over the network. Is there a way
> to encrypt the jobs the client submits to cluster?
define submission?
1. sp
Spark supports client authentication via shared secret or kerberos (on
YARN). However, the job itself is sent unencrypted over the network. Is
there a way to encrypt the jobs the client submits to cluster?
The rational for this is very similar to encrypting the HTTP file server
traffic - Jars may
