[ 
https://issues.apache.org/jira/browse/OOZIE-2540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15666887#comment-15666887
 ] 

Andras Piros commented on OOZIE-2540:
-------------------------------------

Hi [~Dongying Jiao],

{quote}
Is --py-files option a must to run pyspark job? And this option should be local 
path or hdfs path?
{quote}

>From the [*official 
>documentation*|http://spark.apache.org/docs/latest/submitting-applications.html]
> I recommend you to read the section *Advanced Dependency Management*.

> Create a PySpark example
> ------------------------
>
>                 Key: OOZIE-2540
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2540
>             Project: Oozie
>          Issue Type: Task
>          Components: examples
>    Affects Versions: trunk
>            Reporter: Robert Kanter
>
> Now that we have PySpark working correctly in the Spark Action, we should 
> make an example that runs a PySpark job to give users an example of how to do 
> it.  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to