-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/64085/
-----------------------------------------------------------
Review request for Ambari, Dmytro Grinenko and Dmitro Lisnichenko.
Bugs: AMBARI-22522
https://issues.apache.org/jira/browse/AMBARI-22522
Repository: ambari
Description
-------
*STR*
# Deployed cluster with Ambari version: 2.4.3.0-30 and HDP version: 2.5.5.0-157
# Upgrade Ambari to 2.6.1.0-43
# Start EU to 2.6.4.0-36 and downgrade at final step
*Result*
Observed during downgrade that Livy server start failed with below error:
{code}
File
"/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
line 120, in action_create
raise Fail("Applying %s failed, parent directory %s doesn't exist" %
(self.resource, dirname))
resource_management.core.exceptions.Fail: Applying
File['/usr/hdp/current/livy-server/conf/livy-env.sh'] failed, parent directory
/usr/hdp/current/livy-server/conf doesn't exist
{code}
On livy node, observed the following:
{code}
root@ctr-e134-1499953498516-324773-01-000007:/usr/hdp/current/livy-server# ls
-la /usr/hdp/current/livy-server/
total 40
drwxr-xr-x 8 root root 4096 Nov 20 23:49 .
drwxr-xr-x 42 root root 4096 Nov 21 00:05 ..
drwxr-xr-x 2 root root 4096 Nov 20 23:43 bin
lrwxrwxrwx 1 root root 14 Apr 21 2017 conf -> /etc/livy/conf
drwxr-xr-x 3 root root 4096 Nov 20 23:43 etc
drwxr-xr-x 2 root root 12288 Nov 20 23:43 jars
drwxr-xr-x 2 livy livy 4096 Nov 20 23:49 logs
drwxr-xr-x 2 root root 4096 Nov 20 23:43 repl-jars
drwxr-xr-x 2 root root 4096 Nov 20 23:43 rsc-jars
===============
root@ctr-e134-1499953498516-324773-01-000007:~# ls -la /etc/livy/
total 16
drwxr-xr-x 4 root root 4096 Nov 21 04:32 .
drwxr-xr-x 120 root root 4096 Nov 21 03:26 ..
drwxr-xr-x 3 root root 4096 Nov 21 03:30 2.6.4.0-36
lrwxrwxrwx 1 root root 21 Nov 21 04:32 conf -> /usr/hdp/current/livy
drwxr-xr-x 2 root root 4096 Nov 20 23:49 conf.backup
{code}
Looks like there is no directory '/etc/livy/2.5.5.0-157/0'
>From downgrade wizard, found that 'Set Version on All Hosts' Upgrade group
>printed the following for livy:
{code}
2017-11-21 04:32:08,022 - Link['/etc/livy/conf'] {'to': '/usr/hdp/current/livy'}
2017-11-21 04:32:08,022 - Link['/etc/livy/conf'] replacing old symlink to
/grid/0/hdp/current/livy
2017-11-21 04:32:08,022 - Warning: linking to nonexistent location
/usr/hdp/current/livy
2017-11-21 04:32:08,022 - Creating symbolic Link['/etc/livy/conf'] to
/usr/hdp/current/livy
{code}
The cause of this appears to be that livy doesn't create a conf directory as
expected:
{code}
Skipping the conf-select tool on livy since /etc/livy/conf does not exist.
{code}
Diffs
-----
ambari-server/src/main/resources/stacks/BigInsights/4.0/properties/stack_packages.json
7a12011674
ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_packages.json
245449c535
Diff: https://reviews.apache.org/r/64085/diff/1/
Testing
-------
Manual
Thanks,
Jonathan Hurley
