Antonenko Alexander created AMBARI-9873:
-------------------------------------------
Summary: Restart Yarn failed after Ambari only upgrade from 1.6.1
to 2.0.0 and adding Host and Zookeeper Server at this host.
Key: AMBARI-9873
URL: https://issues.apache.org/jira/browse/AMBARI-9873
Project: Ambari
Issue Type: Bug
Components: ambari-web
Affects Versions: 2.0.0
Reporter: Antonenko Alexander
Assignee: Antonenko Alexander
Priority: Blocker
Fix For: 2.0.0
STR:
1)Deploy old version with all services
2)Make ambari only upgrade to 2.0.0
3)Add host
4)Add Zookeeper server at added host.
Actual result:
Restart Yarn failed after
{code}
2015-02-26 17:26:44,346 - Error while executing command 'restart':
Traceback (most recent call last):
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 208, in execute
method(env)
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 354, in restart
self.stop(env)
File
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/nodemanager.py",
line 69, in stop
import params
File
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/params.py",
line 99, in <module>
rm_port =
config['configurations']['yarn-site']['yarn.resourcemanager.webapp.address'].split(':')[-1]
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/config_dictionary.py",
line 79, in __getattr__
raise Fail("Configuration parameter '" + self.name + "' was not found in
configurations dictionary!")
Fail: Configuration parameter 'yarn.resourcemanager.webapp.address' was not
found in configurations dictionary!
stdout: /var/lib/ambari-agent/data/output-320.txt
2015-02-26 17:26:41,118 -
u"Directory['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts/']" {'recursive':
True}
2015-02-26 17:26:41,119 -
u"File['/var/lib/ambari-agent/data/tmp/AMBARI-artifacts//UnlimitedJCEPolicyJDK7.zip']"
{'content':
DownloadSource('http://amb-upg161-rhel6postgresql-external1424940074notkill-2.cs1cloud.internal:8080/resources//UnlimitedJCEPolicyJDK7.zip')}
2015-02-26 17:26:41,119 - Not downloading the file from
http://amb-upg161-rhel6postgresql-external1424940074notkill-2.cs1cloud.internal:8080/resources//UnlimitedJCEPolicyJDK7.zip,
because /var/lib/ambari-agent/data/tmp/UnlimitedJCEPolicyJDK7.zip already
exists
2015-02-26 17:26:41,186 - u"Group['hadoop']" {'ignore_failures': False}
2015-02-26 17:26:41,187 - Modifying group hadoop
2015-02-26 17:26:41,289 - u"Group['nobody']" {'ignore_failures': False}
2015-02-26 17:26:41,290 - Modifying group nobody
2015-02-26 17:26:41,454 - u"Group['users']" {'ignore_failures': False}
2015-02-26 17:26:41,455 - Modifying group users
2015-02-26 17:26:41,588 - u"User['hive']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'hadoop']}
2015-02-26 17:26:41,589 - Modifying user hive
2015-02-26 17:26:41,694 - u"User['oozie']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'users']}
2015-02-26 17:26:41,695 - Modifying user oozie
2015-02-26 17:26:41,744 - u"User['nobody']" {'gid': 'hadoop',
'ignore_failures': False, 'groups': [u'nobody']}
2015-02-26 17:26:41,744 - Modifying user nobody
2015-02-26 17:26:41,789 - u"User['ambari-qa']" {'gid': 'hadoop',
'ignore_failures': False, 'groups': [u'users']}
2015-02-26 17:26:41,790 - Modifying user ambari-qa
2015-02-26 17:26:41,839 - u"User['hdfs']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'hadoop']}
2015-02-26 17:26:41,840 - Modifying user hdfs
2015-02-26 17:26:41,888 - u"User['storm']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'hadoop']}
2015-02-26 17:26:41,889 - Modifying user storm
2015-02-26 17:26:41,934 - u"User['mapred']" {'gid': 'hadoop',
'ignore_failures': False, 'groups': [u'hadoop']}
2015-02-26 17:26:41,935 - Modifying user mapred
2015-02-26 17:26:41,984 - u"User['hbase']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'hadoop']}
2015-02-26 17:26:41,984 - Modifying user hbase
2015-02-26 17:26:42,076 - u"User['tez']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'users']}
2015-02-26 17:26:42,076 - Modifying user tez
2015-02-26 17:26:42,125 - u"User['zookeeper']" {'gid': 'hadoop',
'ignore_failures': False, 'groups': [u'hadoop']}
2015-02-26 17:26:42,126 - Modifying user zookeeper
2015-02-26 17:26:42,172 - u"User['falcon']" {'gid': 'hadoop',
'ignore_failures': False, 'groups': [u'hadoop']}
2015-02-26 17:26:42,172 - Modifying user falcon
2015-02-26 17:26:42,218 - u"User['sqoop']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'hadoop']}
2015-02-26 17:26:42,218 - Modifying user sqoop
2015-02-26 17:26:42,263 - u"User['yarn']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'hadoop']}
2015-02-26 17:26:42,264 - Modifying user yarn
2015-02-26 17:26:42,309 - u"User['hcat']" {'gid': 'hadoop', 'ignore_failures':
False, 'groups': [u'hadoop']}
2015-02-26 17:26:42,309 - Modifying user hcat
2015-02-26 17:26:42,354 -
u"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']" {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2015-02-26 17:26:42,444 -
u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa
/tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']"
{'not_if': 'test $(id -u ambari-qa) -gt 1000'}
2015-02-26 17:26:42,488 - Skipping
u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh ambari-qa
/tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa']"
due to not_if
2015-02-26 17:26:42,488 - u"Directory['/grid/0/hadoop/hbase']" {'owner':
'hbase', 'recursive': True, 'mode': 0775, 'cd_access': 'a'}
2015-02-26 17:26:42,672 -
u"File['/var/lib/ambari-agent/data/tmp/changeUid.sh']" {'content':
StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2015-02-26 17:26:42,767 -
u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase
/home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/grid/0/hadoop/hbase']"
{'not_if': 'test $(id -u hbase) -gt 1000'}
2015-02-26 17:26:42,810 - Skipping
u"Execute['/var/lib/ambari-agent/data/tmp/changeUid.sh hbase
/home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/grid/0/hadoop/hbase']"
due to not_if
2015-02-26 17:26:42,811 - u"Group['hdfs']" {'ignore_failures': False}
2015-02-26 17:26:42,812 - Modifying group hdfs
2015-02-26 17:26:42,938 - u"User['hdfs']" {'groups': [u'hadoop', 'hdfs',
'hadoop', u'hdfs']}
2015-02-26 17:26:42,939 - Modifying user hdfs
2015-02-26 17:26:42,988 - u"Directory['/etc/hadoop']" {'mode': 0755}
2015-02-26 17:26:42,988 - u"Directory['/etc/hadoop/conf.empty']" {'owner':
'hdfs', 'group': 'hadoop', 'recursive': True}
2015-02-26 17:26:42,989 - u"Link['/etc/hadoop/conf']" {'not_if': 'ls
/etc/hadoop/conf', 'to': '/etc/hadoop/conf.empty'}
2015-02-26 17:26:43,035 - Skipping u"Link['/etc/hadoop/conf']" due to not_if
2015-02-26 17:26:43,053 - u"File['/etc/hadoop/conf/hadoop-env.sh']" {'content':
InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}
2015-02-26 17:26:43,116 - u"Execute['('setenforce', '0')']" {'sudo': True,
'only_if': 'test -f /selinux/enforce'}
2015-02-26 17:26:43,185 - Skipping u"Execute['('setenforce', '0')']" due to
only_if
2015-02-26 17:26:43,186 - u"Directory['/grid/0/log/hadoop']" {'owner': 'root',
'mode': 0775, 'group': 'hadoop', 'recursive': True, 'cd_access': 'a'}
2015-02-26 17:26:43,389 - u"Directory['/var/run/hadoop']" {'owner': 'root',
'group': 'root', 'recursive': True, 'cd_access': 'a'}
2015-02-26 17:26:43,532 - u"Directory['/tmp/hadoop-hdfs']" {'owner': 'hdfs',
'recursive': True, 'cd_access': 'a'}
2015-02-26 17:26:43,641 -
u"File['/etc/hadoop/conf/commons-logging.properties']" {'content':
Template('commons-logging.properties.j2'), 'owner': 'hdfs'}
2015-02-26 17:26:43,688 - u"File['/etc/hadoop/conf/health_check']" {'content':
Template('health_check-v2.j2'), 'owner': 'hdfs'}
2015-02-26 17:26:43,733 - u"File['/etc/hadoop/conf/log4j.properties']"
{'content': '...', 'owner': 'hdfs', 'group': 'hadoop', 'mode': 0644}
2015-02-26 17:26:43,801 -
u"File['/etc/hadoop/conf/hadoop-metrics2.properties']" {'content':
Template('hadoop-metrics2.properties.j2'), 'owner': 'hdfs'}
2015-02-26 17:26:43,854 - u"File['/etc/hadoop/conf/task-log4j.properties']"
{'content': StaticFile('task-log4j.properties'), 'mode': 0755}
2015-02-26 17:26:43,947 - u"File['/etc/hadoop/conf/configuration.xsl']"
{'owner': 'hdfs', 'group': 'hadoop'}
2015-02-26 17:26:44,346 - Error while executing command 'restart':
Traceback (most recent call last):
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 208, in execute
method(env)
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 354, in restart
self.stop(env)
File
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/nodemanager.py",
line 69, in stop
import params
File
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/params.py",
line 99, in <module>
rm_port =
config['configurations']['yarn-site']['yarn.resourcemanager.webapp.address'].split(':')[-1]
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/config_dictionary.py",
line 79, in __getattr__
raise Fail("Configuration parameter '" + self.name + "' was not found in
configurations dictionary!")
Fail: Configuration parameter 'yarn.resourcemanager.webapp.address' was not
found in configurations dictionary!
{code}
Expected result
Restart Yarn always passed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
