Re: Review Request 48725: Supervisor start failed after Ambari upgrade (intermittent)

2016-06-15 Thread Dmitro Lisnichenko

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/48725/#review137719
---


Ship it!




Ship It!

- Dmitro Lisnichenko


On June 15, 2016, 3:14 p.m., Andrew Onischuk wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/48725/
> ---
> 
> (Updated June 15, 2016, 3:14 p.m.)
> 
> 
> Review request for Ambari and Dmitro Lisnichenko.
> 
> 
> Bugs: AMBARI-17252
> https://issues.apache.org/jira/browse/AMBARI-17252
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> ambari-server --hash  
> 6cd42e12348dbf0166428bc8b701586bb2c7b0bb  
> Build # - 2.4.0.0-653
> 
> **Steps**
> 
>   1. Deploy HDP-2.4.2.0 cluster with Ambari 2.2.2.0
>   2. Upgrade Ambari to 2.4.0.0
>   3. Stop all services
>   4. Start all services
> 
> Observed below error for Supervisor start
> 
> 
> 
> 
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/STORM/0.9.1/package/scripts/supervisor.py",
>  line 112, in 
> Supervisor().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 257, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/common-services/STORM/0.9.1/package/scripts/supervisor.py",
>  line 88, in start
> service("supervisor", action="start")
>   File 
> "/var/lib/ambari-agent/cache/common-services/STORM/0.9.1/package/scripts/service.py",
>  line 75, in service
> path = params.storm_bin_dir)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 
> 155, in __init__
> self.env.run()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", 
> line 160, in run
> self.run_action(resource, action)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", 
> line 124, in run_action
> provider_action()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
>  line 273, in action_run
> tries=self.resource.tries, try_sleep=self.resource.try_sleep)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 
> 70, in inner
> result = function(command, **kwargs)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 
> 92, in checked_call
> tries=tries, try_sleep=try_sleep)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 
> 140, in _call_wrapper
> result = _call(command, **kwargs_copy)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 
> 293, in _call
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of 
> '/usr/jdk64/jdk1.8.0_77/bin/jps -l  | grep storm.daemon.supervisor$ && 
> /usr/jdk64/jdk1.8.0_77/bin/jps -l  | grep storm.daemon.supervisor$ | awk 
> {'print $1'} > /var/run/storm/supervisor.pid' returned 1.  
> Hortonworks #
> This is MOTD message, added for testing in qe infra
> 
> 
> Note: Afterwards tried to manually start Storm and Supervisor came up fine
> 
> Logs attached
> 
> 
> Diffs
> -
> 
>   ambari-common/src/main/python/resource_management/core/shell.py fac264c 
>   
> ambari-server/src/main/resources/common-services/STORM/0.9.1/package/scripts/service.py
>  6da159a 
>   ambari-server/src/test/python/stacks/2.1/STORM/test_storm_drpc_server.py 
> fba7b9c 
>   ambari-server/src/test/python/stacks/2.1/STORM/test_storm_nimbus.py 0f95a0c 
>   
> ambari-server/src/test/python/stacks/2.1/STORM/test_storm_rest_api_service.py 
> 0fe57cf 
>   ambari-server/src/test/python/stacks/2.1/STORM/test_storm_supervisor.py 
> c70e06c 
>   
> ambari-server/src/test/python/stacks/2.1/STORM/test_storm_supervisor_prod.py 
> f4f6bae 
>   ambari-server/src/test/python/stacks/2.1/STORM/test_storm_ui_server.py 
> 101fbe6 
> 
> Diff: https://reviews.apache.org/r/48725/diff/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Andrew Onischuk
> 
>



Review Request 48725: Supervisor start failed after Ambari upgrade (intermittent)

2016-06-15 Thread Andrew Onischuk

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/48725/
---

Review request for Ambari and Dmitro Lisnichenko.


Bugs: AMBARI-17252
https://issues.apache.org/jira/browse/AMBARI-17252


Repository: ambari


Description
---

ambari-server --hash  
6cd42e12348dbf0166428bc8b701586bb2c7b0bb  
Build # - 2.4.0.0-653

**Steps**

  1. Deploy HDP-2.4.2.0 cluster with Ambari 2.2.2.0
  2. Upgrade Ambari to 2.4.0.0
  3. Stop all services
  4. Start all services

Observed below error for Supervisor start




Traceback (most recent call last):
  File 
"/var/lib/ambari-agent/cache/common-services/STORM/0.9.1/package/scripts/supervisor.py",
 line 112, in 
Supervisor().execute()
  File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 257, in execute
method(env)
  File 
"/var/lib/ambari-agent/cache/common-services/STORM/0.9.1/package/scripts/supervisor.py",
 line 88, in start
service("supervisor", action="start")
  File 
"/var/lib/ambari-agent/cache/common-services/STORM/0.9.1/package/scripts/service.py",
 line 75, in service
path = params.storm_bin_dir)
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", 
line 155, in __init__
self.env.run()
  File 
"/usr/lib/python2.6/site-packages/resource_management/core/environment.py", 
line 160, in run
self.run_action(resource, action)
  File 
"/usr/lib/python2.6/site-packages/resource_management/core/environment.py", 
line 124, in run_action
provider_action()
  File 
"/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
 line 273, in action_run
tries=self.resource.tries, try_sleep=self.resource.try_sleep)
  File 
"/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, 
in inner
result = function(command, **kwargs)
  File 
"/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, 
in checked_call
tries=tries, try_sleep=try_sleep)
  File 
"/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, 
in _call_wrapper
result = _call(command, **kwargs_copy)
  File 
"/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 293, 
in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of 
'/usr/jdk64/jdk1.8.0_77/bin/jps -l  | grep storm.daemon.supervisor$ && 
/usr/jdk64/jdk1.8.0_77/bin/jps -l  | grep storm.daemon.supervisor$ | awk 
{'print $1'} > /var/run/storm/supervisor.pid' returned 1.  Hortonworks 
#
This is MOTD message, added for testing in qe infra


Note: Afterwards tried to manually start Storm and Supervisor came up fine

Logs attached


Diffs
-

  ambari-common/src/main/python/resource_management/core/shell.py fac264c 
  
ambari-server/src/main/resources/common-services/STORM/0.9.1/package/scripts/service.py
 6da159a 
  ambari-server/src/test/python/stacks/2.1/STORM/test_storm_drpc_server.py 
fba7b9c 
  ambari-server/src/test/python/stacks/2.1/STORM/test_storm_nimbus.py 0f95a0c 
  ambari-server/src/test/python/stacks/2.1/STORM/test_storm_rest_api_service.py 
0fe57cf 
  ambari-server/src/test/python/stacks/2.1/STORM/test_storm_supervisor.py 
c70e06c 
  ambari-server/src/test/python/stacks/2.1/STORM/test_storm_supervisor_prod.py 
f4f6bae 
  ambari-server/src/test/python/stacks/2.1/STORM/test_storm_ui_server.py 
101fbe6 

Diff: https://reviews.apache.org/r/48725/diff/


Testing
---

mvn clean test


Thanks,

Andrew Onischuk