John Vines created SPARK-12943:
----------------------------------
Summary: spark should distribute truststore if used in
yarn-cluster mode
Key: SPARK-12943
URL: https://issues.apache.org/jira/browse/SPARK-12943
Project: Spark
Issue Type: Improvement
Components: YARN
Affects Versions: 1.5.2
Reporter: John Vines
spark.ssl.trustStore is used to specify the truststore to use for SSL. It is
described somewhat at
http://spark.apache.org/docs/1.5.2/configuration.html#security
What it does not specify is that, when used in yarn environments, it must be an
absolute path available on all nodes.
In an ideal world, it would recognize it's in yarn-cluster mode, put that file
in the distributed cache, and then update the local conf in each
driver/executor to the local path to use they're local version.
Or at the very least, the docs could be clearer that it's incompatible with
yarn-cluster mode unless you give it a path that's available on all nodes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
