[
https://issues.apache.org/jira/browse/SPARK-14845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-14845:
------------------------------------
Assignee: (was: Apache Spark)
> spark.files in properties file is not distributed to driver in yarn-cluster
> mode
> --------------------------------------------------------------------------------
>
> Key: SPARK-14845
> URL: https://issues.apache.org/jira/browse/SPARK-14845
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit, YARN
> Reporter: Jeff Zhang
> Priority: Minor
>
> I use the following command to run SparkPi example. And in this property
> file, define spark.files. It turns out that in yarn-cluster mode this
> README.md is only distirbuted to executor but not in driver.
> content of properties file
> {noformat}
> spark.files=/Users/jzhang/github/spark/README.md
> {noformat}
> launch command
> {noformat}
> bin/spark-submit --master yarn-cluster --properties-file a.properties --class
> org.apache.spark.examples.SparkPi
> examples/target/original-spark-examples_2.11-2.0.0-SNAPSHOT.jar
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]