Hi All,
I am pretty new to Oozie, and I keep finding that I am getting issues when
running a spark job using Oozie.
I am receiving the following error message when I submit my workflow:
2015-07-16 11:02:01,606 ERROR [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: AM_CONTAINER_ID is null
2015-07-16 11:02:01,608 ERROR [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.io.IOException: AM_CONTAINER_ID is null
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.validateInputParam(MRAppMaster.java:1052)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1068)
Has anyone seen this before?
My workflow is as below:
<workflow-app name="sample-wf" xmlns="uri:oozie:workflow:0.1">
<start to='myfirstsparkjob'/>
<action name="myfirstsparkjob">
<spark xmlns="uri:oozie:spark-action:0.1">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<master>yarn-client</master>
<mode>client</mode>
<name>Spark Example</name>
<class>com.robo.spark.clientJitter</class>
<jar>/lib/robo-analysis-sdk-SNAPSHOT-jar-with-dependencies.jar</jar>
<spark-opts>--executor-memory 2G --num-executors 5</spark-opts>
<arg>/Robo/Datastore/Gigamon/</arg>
</spark>
<ok to="end"/>
<error to="fail"/>
</action>
<kill name="fail">
<message>Java failed, error
message[${wf:errorMessage(wf:lastErrorNode())}]</message>
</kill>
<end name='end' />
</workflow-app>
Thanks!