[
https://issues.apache.org/jira/browse/AMBARI-18383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aravindan Vijayan updated AMBARI-18383:
---------------------------------------
Summary: Oozie spark failed due to incomplete spark share-lib directory
(was: Oozie spark failed due to missing py4j and/or pyspark zip files in share
lib)
> Oozie spark failed due to incomplete spark share-lib directory
> --------------------------------------------------------------
>
> Key: AMBARI-18383
> URL: https://issues.apache.org/jira/browse/AMBARI-18383
> Project: Ambari
> Issue Type: Bug
> Affects Versions: 2.4.0
> Reporter: Aravindan Vijayan
> Assignee: Aravindan Vijayan
> Priority: Blocker
> Fix For: 2.5.0
>
> Attachments: AMBARI-18383.patch
>
>
> Failed exception:
> {noformat}
> "Failing Oozie Launcher, Main class
> [org.apache.oozie.action.hadoop.SparkMain], main()
> threw exception, Missing py4j and/or pyspark zip files. Please add them to
> the lib folder
> or to the Spark sharelib.
> org.apache.oozie.action.hadoop.OozieActionConfiguratorException: Missing py4j
> and/or
> pyspark zip files. Please add them to the lib folder or to the Spark
> sharelib."
> {noformat}
> Those two files were not present in the share lib
> hrt_qa@hn0-3ad6fe:~$ hdfs dfs -ls /user/oozie/share/lib/spark/*.zip
> ls: `/user/oozie/share/lib/spark/*.zip': No such file or directory
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)