-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/64166/
-----------------------------------------------------------
Review request for Ambari, Dmytro Grinenko, Dmitro Lisnichenko, and Nate Cole.
Bugs: AMBARI-22547
https://issues.apache.org/jira/browse/AMBARI-22547
Repository: ambari
Description
-------
*STR*
# Deployed cluster with Ambari version: 2.4.2.0_IBM_000000 and HDP version:
4.2.5.0-0000 (LZO is enabled in HDFS configs)
# Upgrade Ambari to Target Version: 2.6.1.0-64 | Hash:
cd4db8e9ac0ea7ce14fc1253959a121688f34952
# Register HDP-2.6.4.0-51 version and call remove iop-slect
# Install the bits and start EU
*Result*
History server start failed with below error:
```
Traceback (most recent call last):
File
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/historyserver.py",
line 81, in pre_upgrade_restart
copy_to_hdfs("tez", params.user_group, params.hdfs_user,
skip=params.sysprep_skip_copy_tarballs_hdfs)
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/copy_tarball.py",
line 464, in copy_to_hdfs
source_file = prepare_function()
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/copy_tarball.py",
line 94, in _prepare_tez_tarball
hadoop_lib_native_lzo_dir = os.path.join(stack_root, tez_version, "hadoop",
"lib", "native")
File "/usr/lib64/python2.6/posixpath.py", line 65, in join
if b.startswith('/'):
AttributeError: 'NoneType' object has no attribute 'startswith'
```
The error looks to be due to lzo changes, as the following code has the issue:
```
# if enabled, LZO GPL libraries must be copied as well
91 if lzo_utils.should_install_lzo():
92 stack_root = Script.get_stack_root()
93 tez_version =
component_version.get_component_repository_version("TEZ")
94 hadoop_lib_native_lzo_dir = os.path.join(stack_root, tez_version,
"hadoop", "lib", "native")
95
```
**In this system, Tez is not installed and Hive is on MapReduce. However, the
Tez binaries are installed and should be updated in the event that Tez is
installed after upgrade.**
Diffs
-----
ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py
bd1cede834
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py
2871dc0ff3
Diff: https://reviews.apache.org/r/64166/diff/1/
Testing
-------
Manual install & upgrade
Thanks,
Jonathan Hurley
