This is an automatically generated e-mail. To reply, visit:

(Updated Sept. 13, 2016, 9:56 p.m.)

Review request for Ambari, Andrew Onischuk, Laszlo Puskas, Sumit Mohanty, and 
Venkat Ranganathan.

Bugs: AMBARI-18383

Repository: ambari


Failed exception:

"Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], 
threw exception, Missing py4j and/or pyspark zip files. Please add them to the 
lib folder 
or to the Spark sharelib.

org.apache.oozie.action.hadoop.OozieActionConfiguratorException: Missing py4j 
pyspark zip files. Please add them to the lib folder or to the Spark sharelib."

Those two files were not present in the share lib
hrt_qa@hn0-3ad6fe:~$ hdfs dfs -ls /user/oozie/share/lib/spark/*.zip
ls: `/user/oozie/share/lib/spark/*.zip': No such file or directory

Diffs (updated)

  ambari-server/src/main/resources/scripts/Ambaripreupload.py 7c8c601 

Diff: https://reviews.apache.org/r/51863/diff/


Manually tested on sys-prepped cluster. 

Execution log

2016-09-13 21:17:32,590 - Execute[('mv', 
'/usr/hdp/')] {'sudo': True}
2016-09-13 21:17:32,613 - 
Directory['/usr/hdp/'] {'owner': 'oozie', 
'create_parents': True}
2016-09-13 21:17:32,635 - Creating directory 
Directory['/usr/hdp/'] since it doesn't exist.
2016-09-13 21:17:32,746 - Changing owner for 
/usr/hdp/ from 0 to oozie
2016-09-13 21:17:32,771 - Execute['cp -f 
/usr/hdp/'] {'user': 'oozie'}
2016-09-13 21:17:32,804 - Execute['cp -P /usr/hdp/*.jar 
/usr/hdp/'] {'user': 'oozie'}
2016-09-13 21:17:33,125 - Execute['find 
/usr/hdp/ -type l -delete'] {'user': 'oozie'}
2016-09-13 21:17:33,163 - Execute['rm -f 
/usr/hdp/*.jar'] {'user': 
2016-09-13 21:17:33,220 - Execute['cp -f 
/usr/hdp/'] {'user': 'oozie'}
2016-09-13 21:17:33,258 - Execute['cp -f 
/usr/hdp/'] {'user': 'oozie'}
No jar files found in Spark client python lib.
2016-09-13 21:17:33,293 - HdfsResource['/tmp/oozie/user/oozie/share'] 
{'security_enabled': False, 'hadoop_conf_dir': '/etc/hadoop/conf', 'keytab': 
None, 'source': '/usr/hdp/', 'default_fs': 
'adl://oozie3hadl25.azuredatalakestore.net:443', 'user': 'hdfs', 
'/var/lib/ambari-agent/data/.hdfs_resource_ignore', 'hdfs_site': 
{'dfs.webhdfs.enabled': False}, 'kinit_path_local': None, 'principal_name': 
None, 'recursive_chmod': True, 'owner': 'oozie', 'hadoop_bin_dir': 
'/usr/hdp/', 'type': 'directory', 'action': 
['create_on_execute'], 'mode': 0755}


Aravindan Vijayan

Reply via email to