[
https://issues.apache.org/jira/browse/OOZIE-2748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Bacsko updated OOZIE-2748:
--------------------------------
Description:
If we define argument for the Spark action like this
{code}
<spark xmlns="uri:oozie:spark-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<configuration>
<property>
<name>oozie.use.system.libpath</name>
<value>true</value>
</property>
<property>
<name></name>
<value></value>
</property>
</configuration>
<master>yarn-cluster</master>
<mode>cluster</mode>
<name>DataAnalyze</name>
<class> Hive_Cis.DataAnalyze</class>
<jar>${nameNode}/Analytics/Spark_jars/Hive_CIS-1.0-SNAPSHOT-jar-with-dependencies.jar</jar>
<spark-opts>--files
${nameNode}/Analytics/Spark_jars/hive-site.xml</spark-opts>
<arg></arg> <--- cause of the NPE
</spark>
{code}
then we get a NullPointerException in LauncherMapper:
{code}
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain],
exception invoking main(), null
java.lang.NullPointerException
at
org.apache.oozie.action.hadoop.LauncherMapper.printArgs(LauncherMapper.java:627)
at
org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:212)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
...
{code}
was:
If we define argument for the Spark action like this
{code}
<spark xmlns="uri:oozie:spark-action:0.2">
<job-tracker>${jobTracker}</job-tracker>
<name-node>${nameNode}</name-node>
<configuration>
<property>
<name>oozie.use.system.libpath</name>
<value>true</value>
</property>
<property>
<name></name>
<value></value>
</property>
</configuration>
<master>yarn-cluster</master>
<mode>cluster</mode>
<name>DataAnalyze</name>
<class> Hive_Cis.DataAnalyze</class>
<jar>${nameNode}/Analytics/Spark_jars/Hive_CIS-1.0-SNAPSHOT-jar-with-dependencies.jar</jar>
<spark-opts>--files
${nameNode}/Analytics/Spark_jars/hive-site.xml</spark-opts>
<arg></arg>
</spark>
{code}
then we get a NullPointerException in LauncherMapper:
{code}
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain],
exception invoking main(), null
java.lang.NullPointerException
at
org.apache.oozie.action.hadoop.LauncherMapper.printArgs(LauncherMapper.java:627)
at
org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:212)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
...
{code}
> NPE in LauncherMapper.printArgs()
> ---------------------------------
>
> Key: OOZIE-2748
> URL: https://issues.apache.org/jira/browse/OOZIE-2748
> Project: Oozie
> Issue Type: Bug
> Components: core
> Affects Versions: 4.2.0
> Reporter: Peter Bacsko
> Assignee: Peter Bacsko
>
> If we define argument for the Spark action like this
> {code}
> <spark xmlns="uri:oozie:spark-action:0.2">
> <job-tracker>${jobTracker}</job-tracker>
> <name-node>${nameNode}</name-node>
> <configuration>
> <property>
> <name>oozie.use.system.libpath</name>
> <value>true</value>
> </property>
> <property>
> <name></name>
> <value></value>
> </property>
> </configuration>
> <master>yarn-cluster</master>
> <mode>cluster</mode>
> <name>DataAnalyze</name>
> <class> Hive_Cis.DataAnalyze</class>
>
> <jar>${nameNode}/Analytics/Spark_jars/Hive_CIS-1.0-SNAPSHOT-jar-with-dependencies.jar</jar>
> <spark-opts>--files
> ${nameNode}/Analytics/Spark_jars/hive-site.xml</spark-opts>
> <arg></arg> <--- cause of the NPE
> </spark>
> {code}
> then we get a NullPointerException in LauncherMapper:
> {code}
> Failing Oozie Launcher, Main class
> [org.apache.oozie.action.hadoop.SparkMain], exception invoking main(), null
> java.lang.NullPointerException
> at
> org.apache.oozie.action.hadoop.LauncherMapper.printArgs(LauncherMapper.java:627)
> at
> org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:212)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
> ...
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
