[
https://issues.apache.org/jira/browse/AMBARI-22160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Hurley reopened AMBARI-22160:
--------------------------------------
Reverted since HDFS Service Checks are failing after applying this patch. STR:
- Install HDP 2.6.0.0 with HDFS and ZK using a VDF
- Run service check after install
{code}
2017-10-09 16:15:18,577 - Unable to load available packages
Traceback (most recent call last):
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 760, in load_available_packages
self.available_packages_in_repos =
pkg_provider.get_available_packages_in_repos(CommandRepository(config['repositoryFile']))
NameError: global name 'config' is not defined
Traceback (most recent call last):
File
"/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/service_check.py",
line 137, in <module>
HdfsServiceCheck().execute()
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 367, in execute
method(env)
File
"/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/service_check.py",
line 33, in service_check
import params
File
"/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/params.py",
line 25, in <module>
from params_linux import *
File
"/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py",
line 391, in <module>
lzo_packages = get_lzo_packages(stack_version_unformatted)
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/get_lzo_packages.py",
line 45, in get_lzo_packages
lzo_packages +=
[script_instance.format_package_name("hadooplzo_${stack_version}"),
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 537, in format_package_name
raise Fail("Cannot match package for regexp name {0}. Available packages:
{1}".format(name, self.available_packages_in_repos))
resource_management.core.exceptions.Fail: Cannot match package for regexp name
hadooplzo_${stack_version}. Available packages: []
{code}
> hadooplzo package installation failed on devdeploys
> ---------------------------------------------------
>
> Key: AMBARI-22160
> URL: https://issues.apache.org/jira/browse/AMBARI-22160
> Project: Ambari
> Issue Type: Bug
> Reporter: Andrew Onischuk
> Assignee: Andrew Onischuk
> Fix For: 2.6.0
>
> Attachments: AMBARI-22160.patch, AMBARI-22160.patch,
> AMBARI-22160.patch, AMBARI-22160.patch
>
>
> Installation log:
>
>
>
> 2017-10-04 14:21:45,371 - Package['hadooplzo-2-6-3-0-159']
> {'retry_on_repo_unavailability': True, 'retry_count': 5}
> 2017-10-04 14:21:45,395 - Skipping installation of existing package
> hadooplzo-2-6-3-0-159
> 2017-10-04 14:21:45,396 - Package['libhdfs0-2-6-3-0-159']
> {'retry_on_repo_unavailability': True, 'retry_count': 5}
> 2017-10-04 14:21:45,420 - Skipping installation of existing package
> libhdfs0-2-6-3-0-159
> 2017-10-04 14:21:45,424 - Directory['/etc/security/limits.d'] {'owner':
> 'root', 'create_parents': True, 'group': 'root'}
> 2017-10-04 14:21:45,431 - File['/etc/security/limits.d/hdfs.conf']
> {'content': Template('hdfs.conf.j2'), 'owner': 'root', 'group': 'root',
> 'mode': 0644}
> 2017-10-04 14:21:45,432 - Writing
> File['/etc/security/limits.d/hdfs.conf'] because it doesn't exist
> 2017-10-04 14:21:45,432 - Changing permission for
> /etc/security/limits.d/hdfs.conf from 640 to 644
> 2017-10-04 14:21:45,432 - XmlConfig['hadoop-policy.xml'] {'owner':
> 'cstm-hdfs', 'group': 'hadoop', 'conf_dir':
> '/usr/hdp/current/hadoop-client/conf', 'configuration_attributes': {},
> 'configurations': ...}
> 2017-10-04 14:21:45,444 - Generating config:
> /usr/hdp/current/hadoop-client/conf/hadoop-policy.xml
> 2017-10-04 14:21:45,444 -
> File['/usr/hdp/current/hadoop-client/conf/hadoop-policy.xml'] {'owner':
> 'cstm-hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None,
> 'encoding': 'UTF-8'}
> 2017-10-04 14:21:45,453 - Writing
> File['/usr/hdp/current/hadoop-client/conf/hadoop-policy.xml'] because
> contents don't match
> 2017-10-04 14:21:45,454 - Changing owner for
> /usr/hdp/current/hadoop-client/conf/hadoop-policy.xml from 0 to cstm-hdfs
> 2017-10-04 14:21:45,454 - XmlConfig['ssl-client.xml'] {'owner':
> 'cstm-hdfs', 'group': 'hadoop', 'conf_dir':
> '/usr/hdp/current/hadoop-client/conf', 'configuration_attributes': {},
> 'configurations': ...}
> 2017-10-04 14:21:45,463 - Generating config:
> /usr/hdp/current/hadoop-client/conf/ssl-client.xml
> 2017-10-04 14:21:45,464 -
> File['/usr/hdp/current/hadoop-client/conf/ssl-client.xml'] {'owner':
> 'cstm-hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None,
> 'encoding': 'UTF-8'}
> 2017-10-04 14:21:45,470 - Writing
> File['/usr/hdp/current/hadoop-client/conf/ssl-client.xml'] because it doesn't
> exist
> 2017-10-04 14:21:45,470 - Changing owner for
> /usr/hdp/current/hadoop-client/conf/ssl-client.xml from 0 to cstm-hdfs
> 2017-10-04 14:21:45,470 - Changing group for
> /usr/hdp/current/hadoop-client/conf/ssl-client.xml from 0 to hadoop
> 2017-10-04 14:21:45,471 -
> Directory['/usr/hdp/current/hadoop-client/conf/secure'] {'owner': 'root',
> 'create_parents': True, 'group': 'hadoop', 'cd_access': 'a'}
> 2017-10-04 14:21:45,471 - Creating directory
> Directory['/usr/hdp/current/hadoop-client/conf/secure'] since it doesn't
> exist.
> 2017-10-04 14:21:45,471 - Changing group for
> /usr/hdp/current/hadoop-client/conf/secure from 0 to hadoop
> 2017-10-04 14:21:45,472 - XmlConfig['ssl-client.xml'] {'owner':
> 'cstm-hdfs', 'group': 'hadoop', 'conf_dir':
> '/usr/hdp/current/hadoop-client/conf/secure', 'configuration_attributes': {},
> 'configurations': ...}
> 2017-10-04 14:21:45,482 - Generating config:
> /usr/hdp/current/hadoop-client/conf/secure/ssl-client.xml
> 2017-10-04 14:21:45,482 -
> File['/usr/hdp/current/hadoop-client/conf/secure/ssl-client.xml'] {'owner':
> 'cstm-hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None,
> 'encoding': 'UTF-8'}
> 2017-10-04 14:21:45,489 - Writing
> File['/usr/hdp/current/hadoop-client/conf/secure/ssl-client.xml'] because it
> doesn't exist
> 2017-10-04 14:21:45,489 - Changing owner for
> /usr/hdp/current/hadoop-client/conf/secure/ssl-client.xml from 0 to cstm-hdfs
> 2017-10-04 14:21:45,489 - Changing group for
> /usr/hdp/current/hadoop-client/conf/secure/ssl-client.xml from 0 to hadoop
> 2017-10-04 14:21:45,490 - XmlConfig['ssl-server.xml'] {'owner':
> 'cstm-hdfs', 'group': 'hadoop', 'conf_dir':
> '/usr/hdp/current/hadoop-client/conf', 'configuration_attributes': {},
> 'configurations': ...}
> 2017-10-04 14:21:45,499 - Generating config:
> /usr/hdp/current/hadoop-client/conf/ssl-server.xml
> 2017-10-04 14:21:45,499 -
> File['/usr/hdp/current/hadoop-client/conf/ssl-server.xml'] {'owner':
> 'cstm-hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None,
> 'encoding': 'UTF-8'}
> 2017-10-04 14:21:45,506 - Writing
> File['/usr/hdp/current/hadoop-client/conf/ssl-server.xml'] because it doesn't
> exist
> 2017-10-04 14:21:45,506 - Changing owner for
> /usr/hdp/current/hadoop-client/conf/ssl-server.xml from 0 to cstm-hdfs
> 2017-10-04 14:21:45,507 - Changing group for
> /usr/hdp/current/hadoop-client/conf/ssl-server.xml from 0 to hadoop
> 2017-10-04 14:21:45,507 - XmlConfig['hdfs-site.xml'] {'owner':
> 'cstm-hdfs', 'group': 'hadoop', 'conf_dir':
> '/usr/hdp/current/hadoop-client/conf', 'configuration_attributes': {u'final':
> {u'dfs.support.append': u'true', u'dfs.datanode.data.dir': u'true',
> u'dfs.namenode.http-address': u'true', u'dfs.namenode.name.dir': u'true',
> u'dfs.webhdfs.enabled': u'true', u'dfs.datanode.failed.volumes.tolerated':
> u'true'}}, 'configurations': ...}
> 2017-10-04 14:21:45,516 - Generating config:
> /usr/hdp/current/hadoop-client/conf/hdfs-site.xml
> 2017-10-04 14:21:45,517 -
> File['/usr/hdp/current/hadoop-client/conf/hdfs-site.xml'] {'owner':
> 'cstm-hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': None,
> 'encoding': 'UTF-8'}
> 2017-10-04 14:21:45,564 - Writing
> File['/usr/hdp/current/hadoop-client/conf/hdfs-site.xml'] because contents
> don't match
> 2017-10-04 14:21:45,564 - Changing owner for
> /usr/hdp/current/hadoop-client/conf/hdfs-site.xml from 0 to cstm-hdfs
> 2017-10-04 14:21:45,565 - XmlConfig['core-site.xml'] {'group': 'hadoop',
> 'conf_dir': '/usr/hdp/current/hadoop-client/conf', 'mode': 0644,
> 'configuration_attributes': {u'final': {u'fs.defaultFS': u'true'}}, 'owner':
> 'cstm-hdfs', 'configurations': ...}
> 2017-10-04 14:21:45,574 - Generating config:
> /usr/hdp/current/hadoop-client/conf/core-site.xml
> 2017-10-04 14:21:45,575 -
> File['/usr/hdp/current/hadoop-client/conf/core-site.xml'] {'owner':
> 'cstm-hdfs', 'content': InlineTemplate(...), 'group': 'hadoop', 'mode': 0644,
> 'encoding': 'UTF-8'}
> 2017-10-04 14:21:45,604 -
> File['/usr/hdp/current/hadoop-client/conf/slaves'] {'content':
> Template('slaves.j2'), 'owner': 'cstm-hdfs'}
> 2017-10-04 14:21:45,605 - Writing
> File['/usr/hdp/current/hadoop-client/conf/slaves'] because contents don't
> match
> 2017-10-04 14:21:45,605 - Changing owner for
> /usr/hdp/current/hadoop-client/conf/slaves from 0 to cstm-hdfs
> 2017-10-04 14:21:45,606 - Package['liblzo2-2']
> {'retry_on_repo_unavailability': True, 'retry_count': 5}
> 2017-10-04 14:21:45,630 - Installing package liblzo2-2 ('/usr/bin/apt-get
> -q -o Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes
> install liblzo2-2')
> 2017-10-04 14:21:48,997 - Package['hadooplzo-2-6-3-0']
> {'retry_on_repo_unavailability': True, 'retry_count': 5}
> 2017-10-04 14:21:49,021 - Installing package hadooplzo-2-6-3-0
> ('/usr/bin/apt-get -q -o Dpkg::Options::=--force-confdef
> --allow-unauthenticated --assume-yes install hadooplzo-2-6-3-0')
> 2017-10-04 14:21:50,632 - Execution of '/usr/bin/apt-get -q -o
> Dpkg::Options::=--force-confdef --allow-unauthenticated --assume-yes install
> hadooplzo-2-6-3-0' returned 100. Reading package lists...
> Building dependency tree...
> Reading state information...
> W: Target Packages (main/binary-amd64/Packages) is configured multiple
> times in /etc/apt/sources.list.d/ambari-hdp-1.list:1 and
> /etc/apt/sources.list.d/hdp.list:2
> W: Target Packages (main/binary-all/Packages) is configured multiple
> times in /etc/apt/sources.list.d/ambari-hdp-1.list:1 and
> /etc/apt/sources.list.d/hdp.list:2
> W: Target Packages (main/binary-amd64/Packages) is configured multiple
> times in /etc/apt/sources.list.d/ambari-hdp-1.list:2 and
> /etc/apt/sources.list.d/hdp.list:3
> W: Target Packages (main/binary-all/Packages) is configured multiple
> times in /etc/apt/sources.list.d/ambari-hdp-1.list:2 and
> /etc/apt/sources.list.d/hdp.list:3
> E: Unable to locate package hadooplzo-2-6-3-0
> 2017-10-04 14:21:50,632 - Failed to install package hadooplzo-2-6-3-0.
> Executing '/usr/bin/apt-get update -qq'
> 2017-10-04 14:21:52,716 - Retrying to install package hadooplzo-2-6-3-0
> after 30 seconds
>
> Why we trying to install package several times using different package
> version?
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
