[
https://issues.apache.org/jira/browse/OOZIE-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979381#comment-13979381
]
Satish Mittal commented on OOZIE-1806:
--------------------------------------
On debugging, the reason for failure is that mapred.job.classpath.files
property for job contains oozie system/action share lib jars in following
format:
{noformat}
hdfs://hostname:9000/user/oozie/share/lib/lib_20140423063527/hcatalog/commons-beanutils-core-1.8.0.jar:hdfs://hostname:9000/user/oozie/share/lib/lib_20140423063527/hcatalog/commons-compress-1.4.1.jar:...:hdfs://hostname:9000/user/oozie/share/lib/lib_20140423063527/oozie/json-simple-1.1.jar:...
{noformat}
Notice that paths are concatenated with ":" and the paths themselves contain
":" character (which is path.separator on linux). Hence when this string is
split by ":" the paths become invalid. This happens due to a difference in the
implementation of DistributedCache.addFileToClassPath() in 0.20.2 (CDH3u5) vs
hadoop 1.0/1.1.1/1.2.1 and later.
This issue had shown up in 4.0 with OOZIE-1381 and I had fixed it with
OOZIE-1675. In trunk, I am finding that the following 2 patches did this
regression:
- OOZIE-1461 introduced addSystemShareLibForAction() where
DistributedCache.addFileToClasspath() is directly called instead of
addToCache().
- OOZIE-1584: replaced addToCache() with addFileToClasspath() in addShareLib().
> Java Action type jobs are failing with hadoop-0.20.0 and earlier versions on
> oozie trunk
> ----------------------------------------------------------------------------------------
>
> Key: OOZIE-1806
> URL: https://issues.apache.org/jira/browse/OOZIE-1806
> Project: Oozie
> Issue Type: Bug
> Affects Versions: 4.1.0
> Reporter: Satish Mittal
> Assignee: Satish Mittal
> Priority: Blocker
>
> With oozie trunk, all java action type jobs are failing with hadoop 0.20.2
> and earlier versions. This is a regression since oozie 4.0. The map tasks are
> failing with ClassNotFoundException for OozieLauncherInputFormat.EmptySplit
> class.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
