Satish Subhashrao Saley created OOZIE-2512:
----------------------------------------------
Summary: ShareLibservice returns incorrect path for jar
Key: OOZIE-2512
URL: https://issues.apache.org/jira/browse/OOZIE-2512
Project: Oozie
Issue Type: Bug
Reporter: Satish Subhashrao Saley
Assignee: Satish Subhashrao Saley
If we have {{oozie.service.ShareLibService.mapping.file}} setting pointing to a
metafile, then ShareLibServe loads paths from that file.
We can mention path to a directory or path to a direct file.
When path to a directory is mentioned, the paths are populated correctly, but
not when we mentioned direct path for a file.
Consider following paths:
* /sharelib/pig/
** pig.jar
** some.jar
* /sharelib/spark
** spark-assembly.jar
In metafile, we have
{code}
oozie.pig=/sharelib/pig/
oozie.spark=/sharelib/spark/spark-assembly.jar
{code}
Now, the SharelibService calculates the paths as
pig -
hdfs://clustername.com:8020/sharelib/pig/pig.jar,hdfs://clustername.com:8020/sharelib/pig/some.jar
spark - /sharelib/spark/spark-assembly.jar
The spark path does not have hdfs prefixed.
Later on, when we run a spark action, it fails with
{code}
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain],
main() threw exception, File file:/sharelib/spark/spark-assembly.jar does not
exist
java.io.FileNotFoundException: File file:/sharelib/spark/spark-assembly.jar
does not exist
{code}
Remember, if we already mentioned hdfs prefixed paths in metafile, then it
works fine.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
