Hi All,

I am pretty new to Oozie, and I keep finding that I am getting issues when
running a spark job using Oozie.

I am receiving the following error message when I submit my workflow:

2015-07-16 11:02:01,606 ERROR [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: AM_CONTAINER_ID is null
2015-07-16 11:02:01,608 ERROR [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
java.io.IOException: AM_CONTAINER_ID is null
        at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.validateInputParam(MRAppMaster.java:1052)
        at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1068)

Has anyone seen this before?

My workflow is as below:

<workflow-app name="sample-wf" xmlns="uri:oozie:workflow:0.1">
<start to='myfirstsparkjob'/>
    <action name="myfirstsparkjob">
        <spark xmlns="uri:oozie:spark-action:0.1">
            <job-tracker>${jobTracker}</job-tracker>
            <name-node>${nameNode}</name-node>
            <master>yarn-client</master>
            <mode>client</mode>
            <name>Spark Example</name>
            <class>com.robo.spark.clientJitter</class>

<jar>/lib/robo-analysis-sdk-SNAPSHOT-jar-with-dependencies.jar</jar>
            <spark-opts>--executor-memory 2G --num-executors 5</spark-opts>
            <arg>/Robo/Datastore/Gigamon/</arg>
        </spark>
        <ok to="end"/>
        <error to="fail"/>
                </action>
                <kill name="fail">
  <message>Java failed, error
message[${wf:errorMessage(wf:lastErrorNode())}]</message>
 </kill>
                <end name='end' />
</workflow-app>

Thanks!

Reply via email to