Re: Review Request 51766: AMBARI-18351. Preserve output while executing HSI/LLAP's "run.sh" command for launching LLAP.
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51766/#review148387
---
Ship it!
Ship It!
- Sumit Mohanty
On Sept. 9, 2016, 11:42 p.m., Swapan Shridhar wrote:
>
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51766/
> ---
>
> (Updated Sept. 9, 2016, 11:42 p.m.)
>
>
> Review request for Ambari, Alejandro Fernandez, Andrew Onischuk, and Sumit
> Mohanty.
>
>
> Bugs: AMBARI-18351
> https://issues.apache.org/jira/browse/AMBARI-18351
>
>
> Repository: ambari
>
>
> Description
> ---
>
> **Issue:**
>
> Ambari currently runs run.sh for LLAP as such:
>
> ==
> 2016-08-29 20:34:47,770 -
> Execute['/var/lib/ambari-agent/tmp/llap-slider2016-08-29_20-34-01/run.sh']
> {'user': 'hive'}
> 2016-08-29 20:35:51,856 - Submitted LLAP app name : llap0
> ==
>
> Above is from Hive Interactive start operation output. Good to have the
> output (stdout and stderr) of 'run.sh', for debugging purposes.
>
> **Fix:**
>
> - Included the output (stdout and stderr) of 'run.sh' command in the
> operation logs, for debugging purposes.
>
>
> Diffs
> -
>
>
> ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server_interactive.py
> 2df001c
> ambari-server/src/test/python/stacks/2.5/HIVE/test_hive_server_int.py
> 389e45d
>
> Diff: https://reviews.apache.org/r/51766/diff/
>
>
> Testing
> ---
>
> - Python UT passes.
> - Jenkins Pending.
>
> - Tested on live cluster.
> Logs: (o/p of run.sh)
>
> ==
> 2016-09-09 18:30:11,250 -
> checked_call['/var/lib/ambari-agent/tmp/llap-slider2016-09-09_18-24-36/run.sh']
> {'logoutput': True, 'user': 'hive', 'stderr': -1}
> 2016-09-09 18:30:15,750 [main] INFO impl.TimelineClientImpl - Timeline
> service address:
> http://swap-8thsept-hive-2.openstacklocal:8188/ws/v1/timeline/
> 2016-09-09 18:30:17,324 [main] WARN shortcircuit.DomainSocketFactory - The
> short-circuit local reads feature cannot be used because libhadoop cannot be
> loaded.
> 2016-09-09 18:30:17,343 [main] INFO client.RMProxy - Connecting to
> ResourceManager at swap-8thsept-hive-2.openstacklocal/172.22.114.139:8050
> 2016-09-09 18:30:17,581 [main] INFO client.AHSProxy - Connecting to
> Application History server at
> swap-8thsept-hive-2.openstacklocal/172.22.114.139:10200
> 2016-09-09 18:30:17,795 [main] ERROR main.ServiceLauncher - Unknown
> application instance : llap0
> (definition not found at
> hdfs://swap-8thsept-hive-1.openstacklocal:8020/user/hive/.slider/cluster/llap0/app_config.json
> 2016-09-09 18:30:17,799 [main] INFO util.ExitUtil - Exiting with status 69
> 2016-09-09 18:30:23,168 [main] INFO impl.TimelineClientImpl - Timeline
> service address:
> http://swap-8thsept-hive-2.openstacklocal:8188/ws/v1/timeline/
> 2016-09-09 18:30:24,965 [main] WARN shortcircuit.DomainSocketFactory - The
> short-circuit local reads feature cannot be used because libhadoop cannot be
> loaded.
> 2016-09-09 18:30:24,989 [main] INFO client.RMProxy - Connecting to
> ResourceManager at swap-8thsept-hive-2.openstacklocal/172.22.114.139:8050
> 2016-09-09 18:30:25,166 [main] INFO client.AHSProxy - Connecting to
> Application History server at
> swap-8thsept-hive-2.openstacklocal/172.22.114.139:10200
> 2016-09-09 18:30:25,793 [main] INFO imps.CuratorFrameworkImpl - Starting
> 2016-09-09 18:30:25,921 [main-EventThread] INFO state.ConnectionStateManager
> - State change: CONNECTED
> 2016-09-09 18:30:25,978 [main] INFO client.SliderClient - Destroyed cluster
> llap0
> 2016-09-09 18:30:25,981 [main] INFO util.ExitUtil - Exiting with status 0
> 2016-09-09 18:30:30,649 [main] INFO impl.TimelineClientImpl - Timeline
> service address:
> http://swap-8thsept-hive-2.openstacklocal:8188/ws/v1/timeline/
> 2016-09-09 18:30:32,060 [main] WARN shortcircuit.DomainSocketFactory - The
> short-circuit local reads feature cannot be used because libhadoop cannot be
> loaded.
> 2016-09-09 18:30:32,081 [main] INFO client.RMProxy - Connecting to
> ResourceManager at swap-8thsept-hive-2.openstacklocal/172.22.114.139:8050
> 2016-09-09 18:30:32,237 [main] INFO client.AHSProxy - Connecting to
> Application History server at
> swap-8thsept-hive-2.openstacklocal/172.22.114.139:10200
> 2016-09-09 18:30:32,475 [main] WARN client.SliderClient - The
> install-package option has been deprecated. Pl
Review Request 51766: AMBARI-18351. Preserve output while executing HSI/LLAP's "run.sh" command for launching LLAP.
---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51766/
---
Review request for Ambari, Alejandro Fernandez, Andrew Onischuk, and Sumit
Mohanty.
Bugs: AMBARI-18351
https://issues.apache.org/jira/browse/AMBARI-18351
Repository: ambari
Description
---
**Issue:**
Ambari currently runs run.sh for LLAP as such:
==
2016-08-29 20:34:47,770 -
Execute['/var/lib/ambari-agent/tmp/llap-slider2016-08-29_20-34-01/run.sh']
{'user': 'hive'}
2016-08-29 20:35:51,856 - Submitted LLAP app name : llap0
==
Above is from Hive Interactive start operation output. Good to have the output
(stdout and stderr) of 'run.sh', for debugging purposes.
**Fix:**
- Included the output (stdout and stderr) of 'run.sh' command in the operation
logs, for debugging purposes.
Diffs
-
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hive_server_interactive.py
2df001c
ambari-server/src/test/python/stacks/2.5/HIVE/test_hive_server_int.py 389e45d
Diff: https://reviews.apache.org/r/51766/diff/
Testing
---
- Python UT passes.
- Jenkins Pending.
- Tested on live cluster.
Logs: (o/p of run.sh)
==
2016-09-09 18:30:11,250 -
checked_call['/var/lib/ambari-agent/tmp/llap-slider2016-09-09_18-24-36/run.sh']
{'logoutput': True, 'user': 'hive', 'stderr': -1}
2016-09-09 18:30:15,750 [main] INFO impl.TimelineClientImpl - Timeline service
address: http://swap-8thsept-hive-2.openstacklocal:8188/ws/v1/timeline/
2016-09-09 18:30:17,324 [main] WARN shortcircuit.DomainSocketFactory - The
short-circuit local reads feature cannot be used because libhadoop cannot be
loaded.
2016-09-09 18:30:17,343 [main] INFO client.RMProxy - Connecting to
ResourceManager at swap-8thsept-hive-2.openstacklocal/172.22.114.139:8050
2016-09-09 18:30:17,581 [main] INFO client.AHSProxy - Connecting to
Application History server at
swap-8thsept-hive-2.openstacklocal/172.22.114.139:10200
2016-09-09 18:30:17,795 [main] ERROR main.ServiceLauncher - Unknown application
instance : llap0
(definition not found at
hdfs://swap-8thsept-hive-1.openstacklocal:8020/user/hive/.slider/cluster/llap0/app_config.json
2016-09-09 18:30:17,799 [main] INFO util.ExitUtil - Exiting with status 69
2016-09-09 18:30:23,168 [main] INFO impl.TimelineClientImpl - Timeline service
address: http://swap-8thsept-hive-2.openstacklocal:8188/ws/v1/timeline/
2016-09-09 18:30:24,965 [main] WARN shortcircuit.DomainSocketFactory - The
short-circuit local reads feature cannot be used because libhadoop cannot be
loaded.
2016-09-09 18:30:24,989 [main] INFO client.RMProxy - Connecting to
ResourceManager at swap-8thsept-hive-2.openstacklocal/172.22.114.139:8050
2016-09-09 18:30:25,166 [main] INFO client.AHSProxy - Connecting to
Application History server at
swap-8thsept-hive-2.openstacklocal/172.22.114.139:10200
2016-09-09 18:30:25,793 [main] INFO imps.CuratorFrameworkImpl - Starting
2016-09-09 18:30:25,921 [main-EventThread] INFO state.ConnectionStateManager -
State change: CONNECTED
2016-09-09 18:30:25,978 [main] INFO client.SliderClient - Destroyed cluster
llap0
2016-09-09 18:30:25,981 [main] INFO util.ExitUtil - Exiting with status 0
2016-09-09 18:30:30,649 [main] INFO impl.TimelineClientImpl - Timeline service
address: http://swap-8thsept-hive-2.openstacklocal:8188/ws/v1/timeline/
2016-09-09 18:30:32,060 [main] WARN shortcircuit.DomainSocketFactory - The
short-circuit local reads feature cannot be used because libhadoop cannot be
loaded.
2016-09-09 18:30:32,081 [main] INFO client.RMProxy - Connecting to
ResourceManager at swap-8thsept-hive-2.openstacklocal/172.22.114.139:8050
2016-09-09 18:30:32,237 [main] INFO client.AHSProxy - Connecting to
Application History server at
swap-8thsept-hive-2.openstacklocal/172.22.114.139:10200
2016-09-09 18:30:32,475 [main] WARN client.SliderClient - The install-package
option has been deprecated. Please use 'package --install'.
2016-09-09 18:30:32,505 [main] INFO client.SliderClient - Installing package
file:/var/lib/ambari-agent/tmp/llap-slider2016-09-09_18-24-36/llap-09Sep2016.zip
at
hdfs://swap-8thsept-hive-1.openstacklocal:8020/user/hive/.slider/package/LLAP/llap-09Sep2016.zip
and overwrite is true.
2016-09-09 18:30:35,399 [main] INFO util.ExitUtil - Exiting with status 0
2016-09-09 18:30:39,883 [main] INFO impl.TimelineClientImpl - Timeline service
address: http://swap-8thsept-hive-2.openstacklocal:8188/ws/v1/timeline/
2016-09-09 18:30:41,393 [main] WARN shortcircuit.Do
