[
https://issues.apache.org/jira/browse/AMBARI-13828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alejandro Fernandez updated AMBARI-13828:
-----------------------------------------
Description:
Four fixes in one Jira.
1. Knox: message to backup data dir and restore them is wrong for 2.2 and 2.3
upgrade packs.
2. Storm: In HDP 2.1, when stopping just STORM_REST_API, still get this error
when trying to delete it
{code}
[root@alejandro-eu-1 ~]# curl -u admin:admin -X DELETE -H
'X-Requested-By:admin'
http://localhost:8080/api/v1/clusters/c1/services/STORM/components/STORM_REST_API{
"status" : 500,
"message" : "org.apache.ambari.server.controller.spi.SystemException: An
internal system exception occurred: Could not delete service component from
cluster. To remove service component, it must be in
DISABLED/INIT/INSTALLED/INSTALL_FAILED/UNKNOWN/UNINSTALLED/INSTALLING state.,
clusterName=c1, serviceName=STORM, componentName=STORM_REST_API, current
state=STARTED."
{code}
3. NameNode: remove the "namenode_desired_role" param since no longer used.
4. NameNode fails to be restarted in kerberized cluster.
1. Install Ambari 2.1.3 and HDP 2.2
2. Enable Kerberos
3. Perform Express Upgrade
Result:
Observed error at 'Prepare HDFS' phase as follows:
{code}
Traceback (most recent call last):
File
"/var/lib/ambari-agent/cache/custom_actions/scripts/ru_execute_tasks.py", line
156, in <module>
ExecuteUpgradeTasks().execute()
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 218, in execute
method(env)
File
"/var/lib/ambari-agent/cache/custom_actions/scripts/ru_execute_tasks.py", line
153, in actionexecute
shell.checked_call(task.command, logoutput=True, quiet=True)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
line 70, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
line 92, in checked_call
tries=tries, try_sleep=try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
line 140, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
line 291, in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of
'/usr/bin/ambari-python-wrap
/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py
prepare_express_upgrade /var/lib/ambari-agent/data/command-302.json
/var/lib/ambari-agent/cache/custom_actions
/var/lib/ambari-agent/data/structured-out-302.json INFO
/var/lib/ambari-agent/tmp' returned 1. 2015-11-09 07:58:39,343 - Preparing the
NameNodes for a NonRolling (aka Express) Upgrade.
Traceback (most recent call last):
File
"/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py",
line 420, in <module>
NameNode().execute()
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 218, in execute
method(env)
File
"/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py",
line 160, in prepare_express_upgrade
Execute(format("{kinit_path_local} -kt {hdfs_user_keytab}
{hdfs_principal_name}"),
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format.py",
line 90, in format
return ConfigurationFormatter().format(format_string, args, **result)
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format.py",
line 54, in format
result_protected = self.vformat(format_string, args, all_params)
File "/usr/lib64/python2.6/string.py", line 549, in vformat
result = self._vformat(format_string, args, kwargs, used_args, 2)
File "/usr/lib64/python2.6/string.py", line 571, in _vformat
obj, arg_used = self.get_field(field_name, args, kwargs)
File "/usr/lib64/python2.6/string.py", line 632, in get_field
obj = self.get_value(first, args, kwargs)
File "/usr/lib64/python2.6/string.py", line 591, in get_value
return kwargs[key]
File "/usr/lib/python2.6/site-packages/resource_management/core/utils.py",
line 52, in __getitem__
return self._convert_value(self._dict[name])
KeyError: 'kinit_path_local'
{code}
was:
NameNode: remove the "namenode_desired_role" param since no longer used.
Knox: message to backup data dir and restore them is wrong for 2.2 and 2.3
upgrade packs.
Storm: In HDP 2.1, when stopping just STORM_REST_API, still get this error when
trying to delete it
{code}
[root@alejandro-eu-1 ~]# curl -u admin:admin -X DELETE -H
'X-Requested-By:admin'
http://localhost:8080/api/v1/clusters/c1/services/STORM/components/STORM_REST_API{
"status" : 500,
"message" : "org.apache.ambari.server.controller.spi.SystemException: An
internal system exception occurred: Could not delete service component from
cluster. To remove service component, it must be in
DISABLED/INIT/INSTALLED/INSTALL_FAILED/UNKNOWN/UNINSTALLED/INSTALLING state.,
clusterName=c1, serviceName=STORM, componentName=STORM_REST_API, current
state=STARTED."
{code}
NameNode fails to be restarted in kerberized cluster.
1. Install Ambari 2.1.3 and HDP 2.2
2. Enable Kerberos
3. Perform Express Upgrade
Result:
Observed error at 'Prepare HDFS' phase as follows:
{code}
Traceback (most recent call last):
File
"/var/lib/ambari-agent/cache/custom_actions/scripts/ru_execute_tasks.py", line
156, in <module>
ExecuteUpgradeTasks().execute()
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 218, in execute
method(env)
File
"/var/lib/ambari-agent/cache/custom_actions/scripts/ru_execute_tasks.py", line
153, in actionexecute
shell.checked_call(task.command, logoutput=True, quiet=True)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
line 70, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
line 92, in checked_call
tries=tries, try_sleep=try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
line 140, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
line 291, in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of
'/usr/bin/ambari-python-wrap
/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py
prepare_express_upgrade /var/lib/ambari-agent/data/command-302.json
/var/lib/ambari-agent/cache/custom_actions
/var/lib/ambari-agent/data/structured-out-302.json INFO
/var/lib/ambari-agent/tmp' returned 1. 2015-11-09 07:58:39,343 - Preparing the
NameNodes for a NonRolling (aka Express) Upgrade.
Traceback (most recent call last):
File
"/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py",
line 420, in <module>
NameNode().execute()
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
line 218, in execute
method(env)
File
"/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py",
line 160, in prepare_express_upgrade
Execute(format("{kinit_path_local} -kt {hdfs_user_keytab}
{hdfs_principal_name}"),
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format.py",
line 90, in format
return ConfigurationFormatter().format(format_string, args, **result)
File
"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format.py",
line 54, in format
result_protected = self.vformat(format_string, args, all_params)
File "/usr/lib64/python2.6/string.py", line 549, in vformat
result = self._vformat(format_string, args, kwargs, used_args, 2)
File "/usr/lib64/python2.6/string.py", line 571, in _vformat
obj, arg_used = self.get_field(field_name, args, kwargs)
File "/usr/lib64/python2.6/string.py", line 632, in get_field
obj = self.get_value(first, args, kwargs)
File "/usr/lib64/python2.6/string.py", line 591, in get_value
return kwargs[key]
File "/usr/lib/python2.6/site-packages/resource_management/core/utils.py",
line 52, in __getitem__
return self._convert_value(self._dict[name])
KeyError: 'kinit_path_local'
{code}
> Express Upgrade: Misc fixes for NameNode in Kerberized cluster, Storm
> PreCheck, Knox message
> --------------------------------------------------------------------------------------------
>
> Key: AMBARI-13828
> URL: https://issues.apache.org/jira/browse/AMBARI-13828
> Project: Ambari
> Issue Type: Bug
> Components: ambari-server
> Affects Versions: 2.2.0, 2.1.3
> Reporter: Alejandro Fernandez
> Assignee: Alejandro Fernandez
> Fix For: 2.2.0, 2.1.3
>
>
> Four fixes in one Jira.
> 1. Knox: message to backup data dir and restore them is wrong for 2.2 and 2.3
> upgrade packs.
> 2. Storm: In HDP 2.1, when stopping just STORM_REST_API, still get this error
> when trying to delete it
> {code}
> [root@alejandro-eu-1 ~]# curl -u admin:admin -X DELETE -H
> 'X-Requested-By:admin'
> http://localhost:8080/api/v1/clusters/c1/services/STORM/components/STORM_REST_API{
> "status" : 500,
> "message" : "org.apache.ambari.server.controller.spi.SystemException: An
> internal system exception occurred: Could not delete service component from
> cluster. To remove service component, it must be in
> DISABLED/INIT/INSTALLED/INSTALL_FAILED/UNKNOWN/UNINSTALLED/INSTALLING state.,
> clusterName=c1, serviceName=STORM, componentName=STORM_REST_API, current
> state=STARTED."
> {code}
> 3. NameNode: remove the "namenode_desired_role" param since no longer used.
> 4. NameNode fails to be restarted in kerberized cluster.
> 1. Install Ambari 2.1.3 and HDP 2.2
> 2. Enable Kerberos
> 3. Perform Express Upgrade
> Result:
> Observed error at 'Prepare HDFS' phase as follows:
> {code}
> Traceback (most recent call last):
> File
> "/var/lib/ambari-agent/cache/custom_actions/scripts/ru_execute_tasks.py",
> line 156, in <module>
> ExecuteUpgradeTasks().execute()
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 218, in execute
> method(env)
> File
> "/var/lib/ambari-agent/cache/custom_actions/scripts/ru_execute_tasks.py",
> line 153, in actionexecute
> shell.checked_call(task.command, logoutput=True, quiet=True)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 70, in inner
> result = function(command, **kwargs)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 92, in checked_call
> tries=tries, try_sleep=try_sleep)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 140, in _call_wrapper
> result = _call(command, **kwargs_copy)
> File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py",
> line 291, in _call
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of
> '/usr/bin/ambari-python-wrap
> /var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py
> prepare_express_upgrade /var/lib/ambari-agent/data/command-302.json
> /var/lib/ambari-agent/cache/custom_actions
> /var/lib/ambari-agent/data/structured-out-302.json INFO
> /var/lib/ambari-agent/tmp' returned 1. 2015-11-09 07:58:39,343 - Preparing
> the NameNodes for a NonRolling (aka Express) Upgrade.
> Traceback (most recent call last):
> File
> "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py",
> line 420, in <module>
> NameNode().execute()
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
> line 218, in execute
> method(env)
> File
> "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/namenode.py",
> line 160, in prepare_express_upgrade
> Execute(format("{kinit_path_local} -kt {hdfs_user_keytab}
> {hdfs_principal_name}"),
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format.py",
> line 90, in format
> return ConfigurationFormatter().format(format_string, args, **result)
> File
> "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/format.py",
> line 54, in format
> result_protected = self.vformat(format_string, args, all_params)
> File "/usr/lib64/python2.6/string.py", line 549, in vformat
> result = self._vformat(format_string, args, kwargs, used_args, 2)
> File "/usr/lib64/python2.6/string.py", line 571, in _vformat
> obj, arg_used = self.get_field(field_name, args, kwargs)
> File "/usr/lib64/python2.6/string.py", line 632, in get_field
> obj = self.get_value(first, args, kwargs)
> File "/usr/lib64/python2.6/string.py", line 591, in get_value
> return kwargs[key]
> File "/usr/lib/python2.6/site-packages/resource_management/core/utils.py",
> line 52, in __getitem__
> return self._convert_value(self._dict[name])
> KeyError: 'kinit_path_local'
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
