----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/64166/#review192165 -----------------------------------------------------------
Ship it! Ship It! - Nate Cole On Nov. 29, 2017, 11:55 a.m., Jonathan Hurley wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/64166/ > ----------------------------------------------------------- > > (Updated Nov. 29, 2017, 11:55 a.m.) > > > Review request for Ambari, Dmytro Grinenko, Dmitro Lisnichenko, and Nate Cole. > > > Bugs: AMBARI-22547 > https://issues.apache.org/jira/browse/AMBARI-22547 > > > Repository: ambari > > > Description > ------- > > *STR* > # Deployed cluster with Ambari version: 2.4.2.0_IBM_000000 and HDP version: > 4.2.5.0-0000 (LZO is enabled in HDFS configs) > # Upgrade Ambari to Target Version: 2.6.1.0-64 | Hash: > cd4db8e9ac0ea7ce14fc1253959a121688f34952 > # Register HDP-2.6.4.0-51 version and call remove iop-slect > # Install the bits and start EU > > *Result* > History server start failed with below error: > ``` > Traceback (most recent call last): > File > "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/historyserver.py", > line 81, in pre_upgrade_restart > copy_to_hdfs("tez", params.user_group, params.hdfs_user, > skip=params.sysprep_skip_copy_tarballs_hdfs) > File > "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/copy_tarball.py", > line 464, in copy_to_hdfs > source_file = prepare_function() > File > "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/copy_tarball.py", > line 94, in _prepare_tez_tarball > hadoop_lib_native_lzo_dir = os.path.join(stack_root, tez_version, > "hadoop", "lib", "native") > File "/usr/lib64/python2.6/posixpath.py", line 65, in join > if b.startswith('/'): > AttributeError: 'NoneType' object has no attribute 'startswith' > ``` > > The error looks to be due to lzo changes, as the following code has the issue: > ``` > # if enabled, LZO GPL libraries must be copied as well > 91 if lzo_utils.should_install_lzo(): > 92 stack_root = Script.get_stack_root() > 93 tez_version = > component_version.get_component_repository_version("TEZ") > 94 hadoop_lib_native_lzo_dir = os.path.join(stack_root, tez_version, > "hadoop", "lib", "native") > 95 > ``` > > **In this system, Tez is not installed and Hive is on MapReduce. However, the > Tez binaries are installed and should be updated in the event that Tez is > installed after upgrade.** > > > Diffs > ----- > > > ambari-common/src/main/python/resource_management/libraries/functions/copy_tarball.py > bd1cede834 > > ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py > 2871dc0ff3 > > > Diff: https://reviews.apache.org/r/64166/diff/1/ > > > Testing > ------- > > Manual install & upgrade > > > Thanks, > > Jonathan Hurley > >