[
https://issues.apache.org/jira/browse/AMBARI-21624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16110966#comment-16110966
]
Hudson commented on AMBARI-21624:
---------------------------------
SUCCESS: Integrated in Jenkins build Ambari-branch-2.5 #1770 (See
[https://builds.apache.org/job/Ambari-branch-2.5/1770/])
AMBARI-21624. HDFS restart failed post Ambari upgrade when lzo (adoroszlai:
[http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=8f051fc5bb6aa5ca495372a800efabc5191662df])
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/hdfs_nfsgateway.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/params_windows.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/templates/exclude_hosts_list.j2
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/alerts/alert_checkpoint_time.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/hdfs_snamenode.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/files/checkWebUI.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/balancer-emulator/hdfs-command.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/hdfs_namenode.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/install_params.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/service_check.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/templates/hdfs.conf.j2
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/__init__.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/journalnode_upgrade.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/hdfs.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/templates/slaves.j2
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/zkfc_slave.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/alerts/alert_datanode_unmounted_data_dir.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/namenode.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/params_linux.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/snamenode.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/alerts/alert_metrics_deviation.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/hdfs_client.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/params.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/journalnode.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/namenode_ha_state.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/setup_ranger_hdfs.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/alerts/alert_upgrade_finalized.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/datanode_upgrade.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/hdfs_rebalance.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/status_params.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/datanode.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/hdfs_datanode.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/alerts/alert_ha_namenode_health.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/utils.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/namenode_upgrade.py
* (add)
ambari-server/src/main/resources/stacks/BigInsights/4.2.5/services/HDFS/package/scripts/nfsgateway.py
> HDFS restart failed post Ambari upgrade when lzo compression was enabled
> ------------------------------------------------------------------------
>
> Key: AMBARI-21624
> URL: https://issues.apache.org/jira/browse/AMBARI-21624
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
> Affects Versions: 2.5.2
> Reporter: Di Li
> Assignee: Doroszlai, Attila
> Fix For: 2.5.2
>
> Attachments: AMBARI-21624.patch
>
>
> This is specifically for the IOP to HDP migration. We started with an IOP
> 4.2.5 cluster where HDFS had "com.hadoop.compression.lzo" as part of the
> core-site/io.compression.codecs property value. After Ambari upgrade (build
> 2.5.2-155), we couldn't restart HDFS, where it failed with the following
> error (bold/italic for the error line)
> IOP 4.2.5 lzo package is hadoop-lzo-0.5.1-2.x86_64.rpm, which doesn't fit the
> naming convention Ambari 2.5.2 uses (seems to be coming from HDP 2.3 stack
> via inheritance). It's also puzzling why the inheritance as this was right
> after Ambari upgrade where the stack was still IOP 4.2.5 stack that extends
> common services directly.
> {code}
> 2017-07-31 09:00:59,827 - Package['lzo'] {'retry_on_repo_unavailability':
> False, 'retry_count': 5}
> 2017-07-31 09:01:00,355 - Skipping installation of existing package lzo
> 2017-07-31 09:01:00,355 - Package['hadoop-lzo-native']
> {'retry_on_repo_unavailability': False, 'retry_count': 5}
> 2017-07-31 09:01:00,381 - Skipping installation of existing package
> hadoop-lzo-native
> 2017-07-31 09:01:00,381 - Package['hadooplzo_4_2_5_IBM_1_1']
> {'retry_on_repo_unavailability': False, 'retry_count': 5}
> *_2017-07-31 09:01:00,407 - Installing package hadooplzo_4_2_5_IBM_1_1
> ('/usr/bin/yum -d 0 -e 0 -y install hadooplzo_4_2_5_IBM_1_1')
> 2017-07-31 09:01:01,212 - Execution of '/usr/bin/yum -d 0 -e 0 -y install
> hadooplzo_4_2_5_IBM_1_1' returned 1. Error: Nothing to do_*
> 2017-07-31 09:01:01,212 - Failed to install package hadooplzo_4_2_5_IBM_1_1.
> Executing '/usr/bin/yum clean metadata'
> 2017-07-31 09:01:01,553 - Retrying to install package hadooplzo_4_2_5_IBM_1_1
> after 30 seconds
> Command failed after 1 tries
> core-site has io.compression.codecs =
> org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.DefaultCodec,org.apache.hadoop.io.compress.SnappyCodec,com.hadoop.compression.lzo.LzoCodec
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)