Daniel Becker created OOZIE-3332:
------------------------------------
Summary: Update the spark action examples to make it easier to run
them on yarn in client and cluster mode
Key: OOZIE-3332
URL: https://issues.apache.org/jira/browse/OOZIE-3332
Project: Oozie
Issue Type: Improvement
Components: examples
Reporter: Daniel Becker
Assignee: Daniel Becker
The spark and pyspark examples do not have a <mode> element in their
workflow.xml files, probably because of the old way the spark CLI worked, in
which to run spark on yarn in client mode, you would write `--master
yarn-client` on the command line
(https://spark.apache.org/docs/1.5.0/running-on-yarn.html). This still works,
but from spark 1.6, the spark documentation
(https://spark.apache.org/docs/1.6.0/running-on-yarn.html) says the way to do
it is `--master yarn --mode client`.
We should update the two examples to have <mode> elements in workflow.xml and
corresponding values in job.properties.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
