Jeff Zhang created SPARK-14845:
----------------------------------
Summary: spark.files in properties file is not distributed to
driver in yarn-cluster mode
Key: SPARK-14845
URL: https://issues.apache.org/jira/browse/SPARK-14845
Project: Spark
Issue Type: Bug
Components: YARN
Reporter: Jeff Zhang
Priority: Minor
I use the following command to run SparkPi example. And in this property file,
define spark.files. It turns out that in yarn-cluster mode this README.md is
only distirbuted to executor but not in driver.
content of properties file
{noformat}
spark.files=/Users/jzhang/github/spark/README.md
{noformat}
launch command
{noformat}
bin/spark-submit --master yarn-cluster --properties-file a.properties --class
org.apache.spark.examples.SparkPi
examples/target/original-spark-examples_2.11-2.0.0-SNAPSHOT.jar
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
