Andrew Or created SPARK-8017:
--------------------------------
Summary: YARN cluster python --py-files does not work
Key: SPARK-8017
URL: https://issues.apache.org/jira/browse/SPARK-8017
Project: Spark
Issue Type: Bug
Components: PySpark, YARN
Affects Versions: 1.4.0
Reporter: Andrew Or
When I ran the following, it works in client mode but not cluster mode
{code}
bin/spark-submit --master yarn --deploy-mode X --py-files secondary.py app.py
{code}
where app.py depends on secondary.py.
Python YARN cluster mode is added recently so this is not a blocker.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
