date:20160818

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

2016-08-18 Thread Sumit Mohanty



> On Aug. 18, 2016, 8:54 p.m., Sumit Mohanty wrote:
> > ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py,
> >  line 71
> > 
> >
> > Can we call kinit if Kerberos is not enabled? The scenario being Ranger 
> > exists but the cluster is not kerberized.
> 
> Vitalyi Brodetskyi wrote:
> Sorry, i've made changes but planned to test patch tomorrow. Will fix that

Fix it and ship it.


- Sumit


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51143/#review146127
---


On Aug. 18, 2016, 7:42 p.m., Vitalyi Brodetskyi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51143/
> ---
> 
> (Updated Aug. 18, 2016, 7:42 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Andrew Onischuk, Dmitro 
> Lisnichenko, Dmytro Sen, Myroslav Papirkovskyy, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-18165
> https://issues.apache.org/jira/browse/AMBARI-18165
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> {code}
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 198, in 
> HbaseRegionServer().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 280, in execute
> method(env)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 720, in restart
> self.start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 124, in start
> self.post_start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 89, in post_start
> self.apply_atlas_acl(params.hbase_user)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 114, in apply_atlas_acl
> shell.checked_call(format("{kinit_cmd}; {perm_cmd}"), 
> user=params.hbase_user, tries=10, try_sleep=10)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 71, in inner
> result = function(command, **kwargs)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 93, in checked_call
> tries=tries, try_sleep=try_sleep)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 141, in _call_wrapper
> result = _call(command, **kwargs_copy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 294, in _call
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt 
> /etc/security/keytabs/hbase.service.keytab 
> hbase/nat-r6-gjss-ambari-blueprints-4re-1-1.openstacklo...@example.com; echo 
> "grant 'atlas', 'RWXCA', 'atlas_titan'" | hbase shell -n' returned 1. 
>  Hortonworks #
> This is MOTD message, added for testing in qe infra
> ERROR ArgumentError: Can't find a table: atlas_titan
> {code}
> 
> 
> Diffs
> -
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/constants.py
>  c5cbb3f 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata.py
>  7e9c0f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py
>  43b8fb2 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/params.py
>  ab4af79 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/status_params.py
>  76575f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/templates/atlas_hbase_setup.rb.j2
>  PRE-CREATION 
>   
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py
>  a22fe94 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_features.json
>  ed995b2 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/ATLAS/metainfo.xml 
> 4ba59d5 
>   ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 
> a6c8e0f 
>   ambari-server/src/test/python/stacks/2.3/ATLAS/test_metadata_server.py 
> 44841f4 
>   ambari-server/src/test/python/stacks/2.5/ATLAS/test_atlas_server.py 7fdf3e6 
> 
> Diff: https://reviews.apache.org/r/51143/diff/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Vitalyi Brodetskyi
> 
>

Re: Review Request 50047: Kafka listeners property does not show SASL_PLAINTEXT protocol when Kerberos is enabled

2016-08-18 Thread Anita Jebaraj



> On Aug. 18, 2016, 9:11 p.m., Nate Cole wrote:
> > What is the status of this review?  If it has been pushed, please mark it 
> > as Submitted.

The patch was reverted, I will close this review as discarded and open a new 
Review Request for the new patch.


- Anita


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/50047/#review146131
---


On Aug. 3, 2016, 8:47 p.m., Anita Jebaraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/50047/
> ---
> 
> (Updated Aug. 3, 2016, 8:47 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Di Li, Jonathan Hurley, Nate 
> Cole, Robert Levas, and Sriharsha Chintalapani.
> 
> 
> Bugs: AMBARI-17694
> https://issues.apache.org/jira/browse/AMBARI-17694
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> When kerberos is enabled, the protocol for listeners in 
> /etc/kafka/conf/server.properties is updated from PLAINTEXT to PLAINTEXTSASL, 
> even though the Ambari UI shows otherwise
> 
> 
> The patch was reverted due to a conflict, Based on Robert's comment there are 
> two versions of kerberos.json, 
> 
> …/stacks/HDP/2.5/services/KAFKA/kerberos.json
> …/resources/common-services/KAFKA/0.9.0/kerberos.json
> 
> The new version …/stacks/HDP/2.5/services/KAFKA/kerberos.json (AMBARI-17902) 
> has been added after the patch was committed for this review. I have included 
> the changes in the updated patch.
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/java/org/apache/ambari/server/state/kerberos/VariableReplacementHelper.java
>  66be3bf 
>   ambari-server/src/main/resources/common-services/KAFKA/0.10.0/kerberos.json 
> e1e6461 
>   
> ambari-server/src/main/resources/common-services/KAFKA/0.8.1/package/scripts/kafka.py
>  ac7b0ae 
>   ambari-server/src/main/resources/common-services/KAFKA/0.9.0/kerberos.json 
> 2b1c01b 
>   
> ambari-server/src/test/java/org/apache/ambari/server/state/kerberos/VariableReplacementHelperTest.java
>  ee2a671 
> 
> Diff: https://reviews.apache.org/r/50047/diff/
> 
> 
> Testing
> ---
> 
> Added 1 new test case,
>  Ran mvn test
>  Tested in Ambari UI, by enabling kerberos, listeners protocol is updated and 
> kafka started successfully
> 
> 
> Thanks,
> 
> Anita Jebaraj
> 
>

Review Request 51222: RU, order Kafka right after Ranger and before HDFS in upgrade pack

2016-08-18 Thread Alejandro Fernandez


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51222/
---

Review request for Ambari, Dmytro Grinenko, Jonathan Hurley, Nate Cole, and 
Nahappan Somasundaram.


Bugs: AMBARI-18205
https://issues.apache.org/jira/browse/AMBARI-18205


Repository: ambari


Description
---

The Rolling Upgrade packs have the wrong order for Kafka since it should be 
right after Ranger and before HDFS.
Kafka is one of the plugins supported by Ranger, so if the plugin is enabled, 
then during RU the "get repo call" fails with 25 tries.


Diffs
-

  ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.3.xml 
2015440 
  ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.4.xml 
617b261 
  ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.5.xml 
839e544 
  ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.4.xml 
0374615 
  ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.5.xml 
f5d7b18 
  
ambari-server/src/main/resources/stacks/HDP/2.5/services/HIVE/configuration/hive-site.xml
 bf1de39 
  ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.5.xml 
1ce75d9 

Diff: https://reviews.apache.org/r/51222/diff/


Testing
---

Waiting for unit test results


Thanks,

Alejandro Fernandez

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

2016-08-18 Thread Sumit Mohanty


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51143/#review146127
---




ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py
 (line 71)


Can we call kinit if Kerberos is not enabled? The scenario being Ranger 
exists but the cluster is not kerberized.


- Sumit Mohanty


On Aug. 18, 2016, 7:42 p.m., Vitalyi Brodetskyi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51143/
> ---
> 
> (Updated Aug. 18, 2016, 7:42 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Andrew Onischuk, Dmitro 
> Lisnichenko, Dmytro Sen, Myroslav Papirkovskyy, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-18165
> https://issues.apache.org/jira/browse/AMBARI-18165
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> {code}
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 198, in 
> HbaseRegionServer().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 280, in execute
> method(env)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 720, in restart
> self.start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 124, in start
> self.post_start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 89, in post_start
> self.apply_atlas_acl(params.hbase_user)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 114, in apply_atlas_acl
> shell.checked_call(format("{kinit_cmd}; {perm_cmd}"), 
> user=params.hbase_user, tries=10, try_sleep=10)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 71, in inner
> result = function(command, **kwargs)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 93, in checked_call
> tries=tries, try_sleep=try_sleep)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 141, in _call_wrapper
> result = _call(command, **kwargs_copy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 294, in _call
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt 
> /etc/security/keytabs/hbase.service.keytab 
> hbase/nat-r6-gjss-ambari-blueprints-4re-1-1.openstacklo...@example.com; echo 
> "grant 'atlas', 'RWXCA', 'atlas_titan'" | hbase shell -n' returned 1. 
>  Hortonworks #
> This is MOTD message, added for testing in qe infra
> ERROR ArgumentError: Can't find a table: atlas_titan
> {code}
> 
> 
> Diffs
> -
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/constants.py
>  c5cbb3f 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata.py
>  7e9c0f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py
>  43b8fb2 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/params.py
>  ab4af79 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/status_params.py
>  76575f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/templates/atlas_hbase_setup.rb.j2
>  PRE-CREATION 
>   
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py
>  a22fe94 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_features.json
>  ed995b2 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/ATLAS/metainfo.xml 
> 4ba59d5 
>   ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 
> a6c8e0f 
>   ambari-server/src/test/python/stacks/2.3/ATLAS/test_metadata_server.py 
> 44841f4 
>   ambari-server/src/test/python/stacks/2.5/ATLAS/test_atlas_server.py 7fdf3e6 
> 
> Diff: https://reviews.apache.org/r/51143/diff/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Vitalyi Brodetskyi
> 
>

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

2016-08-18 Thread Dmytro Grinenko



> On Aug. 18, 2016, 8:22 p.m., Dmytro Grinenko wrote:
> > Ship It!

After fixing issue above.


- Dmytro


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51143/#review146124
---


On Aug. 18, 2016, 7:42 p.m., Vitalyi Brodetskyi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51143/
> ---
> 
> (Updated Aug. 18, 2016, 7:42 p.m.)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Andrew Onischuk, Dmitro 
> Lisnichenko, Dmytro Sen, Myroslav Papirkovskyy, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-18165
> https://issues.apache.org/jira/browse/AMBARI-18165
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> {code}
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 198, in 
> HbaseRegionServer().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 280, in execute
> method(env)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 720, in restart
> self.start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 124, in start
> self.post_start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 89, in post_start
> self.apply_atlas_acl(params.hbase_user)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 114, in apply_atlas_acl
> shell.checked_call(format("{kinit_cmd}; {perm_cmd}"), 
> user=params.hbase_user, tries=10, try_sleep=10)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 71, in inner
> result = function(command, **kwargs)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 93, in checked_call
> tries=tries, try_sleep=try_sleep)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 141, in _call_wrapper
> result = _call(command, **kwargs_copy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 294, in _call
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt 
> /etc/security/keytabs/hbase.service.keytab 
> hbase/nat-r6-gjss-ambari-blueprints-4re-1-1.openstacklo...@example.com; echo 
> "grant 'atlas', 'RWXCA', 'atlas_titan'" | hbase shell -n' returned 1. 
>  Hortonworks #
> This is MOTD message, added for testing in qe infra
> ERROR ArgumentError: Can't find a table: atlas_titan
> {code}
> 
> 
> Diffs
> -
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/constants.py
>  c5cbb3f 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata.py
>  7e9c0f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py
>  43b8fb2 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/params.py
>  ab4af79 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/status_params.py
>  76575f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/templates/atlas_hbase_setup.rb.j2
>  PRE-CREATION 
>   
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py
>  a22fe94 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_features.json
>  ed995b2 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/ATLAS/metainfo.xml 
> 4ba59d5 
>   ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 
> a6c8e0f 
>   ambari-server/src/test/python/stacks/2.3/ATLAS/test_metadata_server.py 
> 44841f4 
>   ambari-server/src/test/python/stacks/2.5/ATLAS/test_atlas_server.py 7fdf3e6 
> 
> Diff: https://reviews.apache.org/r/51143/diff/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Vitalyi Brodetskyi
> 
>

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

2016-08-18 Thread Vitalyi Brodetskyi


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51143/
---

(Updated Сер. 18, 2016, 7:42 після полудня)


Review request for Ambari, Alejandro Fernandez, Andrew Onischuk, Dmitro 
Lisnichenko, Dmytro Sen, Myroslav Papirkovskyy, and Sumit Mohanty.


Bugs: AMBARI-18165
https://issues.apache.org/jira/browse/AMBARI-18165


Repository: ambari


Description
---

{code}
Traceback (most recent call last):
  File 
"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
 line 198, in 
HbaseRegionServer().execute()
  File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 280, in execute
method(env)
  File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 720, in restart
self.start(env, upgrade_type=upgrade_type)
  File 
"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
 line 124, in start
self.post_start(env, upgrade_type=upgrade_type)
  File 
"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
 line 89, in post_start
self.apply_atlas_acl(params.hbase_user)
  File 
"/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
 line 114, in apply_atlas_acl
shell.checked_call(format("{kinit_cmd}; {perm_cmd}"), 
user=params.hbase_user, tries=10, try_sleep=10)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
line 71, in inner
result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
line 93, in checked_call
tries=tries, try_sleep=try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
line 141, in _call_wrapper
result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
line 294, in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt 
/etc/security/keytabs/hbase.service.keytab 
hbase/nat-r6-gjss-ambari-blueprints-4re-1-1.openstacklo...@example.com; echo 
"grant 'atlas', 'RWXCA', 'atlas_titan'" | hbase shell -n' returned 1.  
Hortonworks #
This is MOTD message, added for testing in qe infra
ERROR ArgumentError: Can't find a table: atlas_titan
{code}


Diffs (updated)
-

  
ambari-common/src/main/python/resource_management/libraries/functions/constants.py
 c5cbb3f 
  
ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata.py
 7e9c0f6 
  
ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py
 43b8fb2 
  
ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/params.py
 ab4af79 
  
ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/status_params.py
 76575f6 
  
ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/templates/atlas_hbase_setup.rb.j2
 PRE-CREATION 
  
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py
 a22fe94 
  
ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_features.json
 ed995b2 
  ambari-server/src/main/resources/stacks/HDP/2.5/services/ATLAS/metainfo.xml 
4ba59d5 
  ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 
a6c8e0f 
  ambari-server/src/test/python/stacks/2.3/ATLAS/test_metadata_server.py 
44841f4 
  ambari-server/src/test/python/stacks/2.5/ATLAS/test_atlas_server.py 7fdf3e6 

Diff: https://reviews.apache.org/r/51143/diff/


Testing
---

mvn clean test


Thanks,

Vitalyi Brodetskyi

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

2016-08-18 Thread Vitalyi Brodetskyi



> On Сер. 18, 2016, 5:38 після полудня, Sumit Mohanty wrote:
> > ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py,
> >  line 71
> > 
> >
> > Should not kinit call be conditional, only if its a secure deployment?
> 
> Vitalyi Brodetskyi wrote:
> In scope of hbase, we need it only for secured cluster, on non-secure 
> cluster it will fail. But for non-secure cluster with Ranger it will work 
> fine according to this comment 
> https://hortonworks.jira.com/browse/BUG-64392?focusedCommentId=451619=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-451619
> Show i create jira and fix it for Ranger too?
> 
> Sumit Mohanty wrote:
> Lets have the changes in one patch. If we need to set ACL when Ranger 
> enabled but not Kerberos then we need to make it conditional. If not then the 
> change is fine.

Ok will add this changes


- Vitalyi


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51143/#review146101
---


On Сер. 18, 2016, 6:51 після полудня, Vitalyi Brodetskyi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51143/
> ---
> 
> (Updated Сер. 18, 2016, 6:51 після полудня)
> 
> 
> Review request for Ambari, Alejandro Fernandez, Andrew Onischuk, Dmitro 
> Lisnichenko, Dmytro Sen, Myroslav Papirkovskyy, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-18165
> https://issues.apache.org/jira/browse/AMBARI-18165
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> {code}
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 198, in 
> HbaseRegionServer().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 280, in execute
> method(env)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 720, in restart
> self.start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 124, in start
> self.post_start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 89, in post_start
> self.apply_atlas_acl(params.hbase_user)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 114, in apply_atlas_acl
> shell.checked_call(format("{kinit_cmd}; {perm_cmd}"), 
> user=params.hbase_user, tries=10, try_sleep=10)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 71, in inner
> result = function(command, **kwargs)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 93, in checked_call
> tries=tries, try_sleep=try_sleep)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 141, in _call_wrapper
> result = _call(command, **kwargs_copy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 294, in _call
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt 
> /etc/security/keytabs/hbase.service.keytab 
> hbase/nat-r6-gjss-ambari-blueprints-4re-1-1.openstacklo...@example.com; echo 
> "grant 'atlas', 'RWXCA', 'atlas_titan'" | hbase shell -n' returned 1. 
>  Hortonworks #
> This is MOTD message, added for testing in qe infra
> ERROR ArgumentError: Can't find a table: atlas_titan
> {code}
> 
> 
> Diffs
> -
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/constants.py
>  c5cbb3f 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata.py
>  7e9c0f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py
>  43b8fb2 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/params.py
>  ab4af79 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/status_params.py
>  76575f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/templates/atlas_hbase_setup.rb.j2
>  PRE-CREATION 
>   
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py
>  a22fe94 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_features.json
>  ed995b2 
>

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

2016-08-18 Thread Vitalyi Brodetskyi



> On Сер. 18, 2016, 5:31 після полудня, Alejandro Fernandez wrote:
> > ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py,
> >  line 94
> > 
> >
> > If the unit test fails, we should remove it or fix it.

ok will remove it. This code is invalid so we don't need test for it too.


- Vitalyi


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51143/#review146099
---


On Сер. 18, 2016, 4:04 після полудня, Vitalyi Brodetskyi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51143/
> ---
> 
> (Updated Сер. 18, 2016, 4:04 після полудня)
> 
> 
> Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, Dmytro Sen, 
> Myroslav Papirkovskyy, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-18165
> https://issues.apache.org/jira/browse/AMBARI-18165
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> {code}
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 198, in 
> HbaseRegionServer().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 280, in execute
> method(env)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 720, in restart
> self.start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 124, in start
> self.post_start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 89, in post_start
> self.apply_atlas_acl(params.hbase_user)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 114, in apply_atlas_acl
> shell.checked_call(format("{kinit_cmd}; {perm_cmd}"), 
> user=params.hbase_user, tries=10, try_sleep=10)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 71, in inner
> result = function(command, **kwargs)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 93, in checked_call
> tries=tries, try_sleep=try_sleep)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 141, in _call_wrapper
> result = _call(command, **kwargs_copy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 294, in _call
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt 
> /etc/security/keytabs/hbase.service.keytab 
> hbase/nat-r6-gjss-ambari-blueprints-4re-1-1.openstacklo...@example.com; echo 
> "grant 'atlas', 'RWXCA', 'atlas_titan'" | hbase shell -n' returned 1. 
>  Hortonworks #
> This is MOTD message, added for testing in qe infra
> ERROR ArgumentError: Can't find a table: atlas_titan
> {code}
> 
> 
> Diffs
> -
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/constants.py
>  c5cbb3f 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata.py
>  7e9c0f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py
>  43b8fb2 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/params.py
>  ab4af79 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/status_params.py
>  76575f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/templates/atlas_hbase_setup.rb.j2
>  PRE-CREATION 
>   
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py
>  a22fe94 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_features.json
>  ed995b2 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/ATLAS/metainfo.xml 
> 4ba59d5 
>   ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 
> a6c8e0f 
> 
> Diff: https://reviews.apache.org/r/51143/diff/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Vitalyi Brodetskyi
> 
>

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

2016-08-18 Thread Sumit Mohanty


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51143/#review146101
---




ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py
 (line 71)


Should not kinit call be conditional, only if its a secure deployment?



ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py
 (line 89)


Lets delete this line as well.



ambari-server/src/main/resources/stacks/HDP/2.5/services/ATLAS/metainfo.xml 
(line 34)


I was expecting an kerberos.json change to ensure that hbase user keytab is 
available on the same host as Atlas Metadata server.


- Sumit Mohanty


On Aug. 18, 2016, 4:04 p.m., Vitalyi Brodetskyi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51143/
> ---
> 
> (Updated Aug. 18, 2016, 4:04 p.m.)
> 
> 
> Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, Dmytro Sen, 
> Myroslav Papirkovskyy, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-18165
> https://issues.apache.org/jira/browse/AMBARI-18165
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> {code}
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 198, in 
> HbaseRegionServer().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 280, in execute
> method(env)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 720, in restart
> self.start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 124, in start
> self.post_start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 89, in post_start
> self.apply_atlas_acl(params.hbase_user)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 114, in apply_atlas_acl
> shell.checked_call(format("{kinit_cmd}; {perm_cmd}"), 
> user=params.hbase_user, tries=10, try_sleep=10)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 71, in inner
> result = function(command, **kwargs)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 93, in checked_call
> tries=tries, try_sleep=try_sleep)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 141, in _call_wrapper
> result = _call(command, **kwargs_copy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 294, in _call
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt 
> /etc/security/keytabs/hbase.service.keytab 
> hbase/nat-r6-gjss-ambari-blueprints-4re-1-1.openstacklo...@example.com; echo 
> "grant 'atlas', 'RWXCA', 'atlas_titan'" | hbase shell -n' returned 1. 
>  Hortonworks #
> This is MOTD message, added for testing in qe infra
> ERROR ArgumentError: Can't find a table: atlas_titan
> {code}
> 
> 
> Diffs
> -
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/constants.py
>  c5cbb3f 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata.py
>  7e9c0f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py
>  43b8fb2 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/params.py
>  ab4af79 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/status_params.py
>  76575f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/templates/atlas_hbase_setup.rb.j2
>  PRE-CREATION 
>   
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py
>  a22fe94 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_features.json
>  ed995b2 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/ATLAS/metainfo.xml 
> 4ba59d5 
>   ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 
> a6c8e0f 
> 
> Diff: https://reviews.apache.org/r/51143/diff/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Vitalyi Brodetskyi
> 
>

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

2016-08-18 Thread Alejandro Fernandez


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51143/#review146099
---




ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 
(line 94)


If the unit test fails, we should remove it or fix it.


- Alejandro Fernandez


On Aug. 18, 2016, 4:04 p.m., Vitalyi Brodetskyi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51143/
> ---
> 
> (Updated Aug. 18, 2016, 4:04 p.m.)
> 
> 
> Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, Dmytro Sen, 
> Myroslav Papirkovskyy, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-18165
> https://issues.apache.org/jira/browse/AMBARI-18165
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> {code}
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 198, in 
> HbaseRegionServer().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 280, in execute
> method(env)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 720, in restart
> self.start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 124, in start
> self.post_start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 89, in post_start
> self.apply_atlas_acl(params.hbase_user)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 114, in apply_atlas_acl
> shell.checked_call(format("{kinit_cmd}; {perm_cmd}"), 
> user=params.hbase_user, tries=10, try_sleep=10)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 71, in inner
> result = function(command, **kwargs)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 93, in checked_call
> tries=tries, try_sleep=try_sleep)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 141, in _call_wrapper
> result = _call(command, **kwargs_copy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 294, in _call
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt 
> /etc/security/keytabs/hbase.service.keytab 
> hbase/nat-r6-gjss-ambari-blueprints-4re-1-1.openstacklo...@example.com; echo 
> "grant 'atlas', 'RWXCA', 'atlas_titan'" | hbase shell -n' returned 1. 
>  Hortonworks #
> This is MOTD message, added for testing in qe infra
> ERROR ArgumentError: Can't find a table: atlas_titan
> {code}
> 
> 
> Diffs
> -
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/constants.py
>  c5cbb3f 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata.py
>  7e9c0f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py
>  43b8fb2 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/params.py
>  ab4af79 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/status_params.py
>  76575f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/templates/atlas_hbase_setup.rb.j2
>  PRE-CREATION 
>   
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py
>  a22fe94 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_features.json
>  ed995b2 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/ATLAS/metainfo.xml 
> 4ba59d5 
>   ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 
> a6c8e0f 
> 
> Diff: https://reviews.apache.org/r/51143/diff/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Vitalyi Brodetskyi
> 
>

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

2016-08-18 Thread Alejandro Fernandez


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51143/#review146098
---




ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/params.py
 (line 239)


This may work technically because Atlas must be removed during EU/RU to HDP 
2.5, but we should be using params.version instead of stack_version_formatted

e.g., calculate it on the actual python file that uses it since it knows 
about upgrade_type.

effective_version = format_stack_version(params.version) if upgrade_type is 
not None else params.stack_version_formatted


- Alejandro Fernandez


On Aug. 18, 2016, 4:04 p.m., Vitalyi Brodetskyi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51143/
> ---
> 
> (Updated Aug. 18, 2016, 4:04 p.m.)
> 
> 
> Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, Dmytro Sen, 
> Myroslav Papirkovskyy, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-18165
> https://issues.apache.org/jira/browse/AMBARI-18165
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> {code}
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 198, in 
> HbaseRegionServer().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 280, in execute
> method(env)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 720, in restart
> self.start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 124, in start
> self.post_start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 89, in post_start
> self.apply_atlas_acl(params.hbase_user)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 114, in apply_atlas_acl
> shell.checked_call(format("{kinit_cmd}; {perm_cmd}"), 
> user=params.hbase_user, tries=10, try_sleep=10)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 71, in inner
> result = function(command, **kwargs)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 93, in checked_call
> tries=tries, try_sleep=try_sleep)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 141, in _call_wrapper
> result = _call(command, **kwargs_copy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 294, in _call
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt 
> /etc/security/keytabs/hbase.service.keytab 
> hbase/nat-r6-gjss-ambari-blueprints-4re-1-1.openstacklo...@example.com; echo 
> "grant 'atlas', 'RWXCA', 'atlas_titan'" | hbase shell -n' returned 1. 
>  Hortonworks #
> This is MOTD message, added for testing in qe infra
> ERROR ArgumentError: Can't find a table: atlas_titan
> {code}
> 
> 
> Diffs
> -
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/constants.py
>  c5cbb3f 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata.py
>  7e9c0f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py
>  43b8fb2 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/params.py
>  ab4af79 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/status_params.py
>  76575f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/templates/atlas_hbase_setup.rb.j2
>  PRE-CREATION 
>   
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py
>  a22fe94 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_features.json
>  ed995b2 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/ATLAS/metainfo.xml 
> 4ba59d5 
>   ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 
> a6c8e0f 
> 
> Diff: https://reviews.apache.org/r/51143/diff/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Vitalyi Brodetskyi
> 
>

Review Request 51207: Wrong hostname in timeline.metrics.service.webapp.address breaks AMS HA

2016-08-18 Thread Dmytro Sen


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51207/
---

Review request for Ambari, Aravindan Vijayan and Sid Wagle.


Bugs: AMBARI-18199
https://issues.apache.org/jira/browse/AMBARI-18199


Repository: ambari


Description
---

On adding additional Collector the webapp address contains wrong hostname.

java.net.BindException: Port in use: ambari-sid-5.com:6188
at 
org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:919)
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:856)
at org.apache.hadoop.yarn.webapp.WebApps$Builder.start(WebApps.java:374)
at 
org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.startWebApp(ApplicationHistoryServer.java:180)
at 
org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.serviceStart(ApplicationHistoryServer.java:92)
at 
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at 
org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.launchAppHistoryServer(ApplicationHistoryServer.java:138)
at 
org.apache.hadoop.yarn.server.applicationhistoryservice.ApplicationHistoryServer.main(ApplicationHistoryServer.java:147)
Caused by: java.net.BindException: Cannot assign requested address

Stop storing collector hostnames in timeline.metrics.service.webapp.address 
property


Diffs
-

  ambari-agent/src/test/python/ambari_agent/TestAlerts.py e114daa 
  ambari-common/src/main/python/ambari_commons/ambari_metrics_helper.py 
PRE-CREATION 
  
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/params.py
 7352f33 
  
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-site.xml
 c02df71 
  
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/scripts/params.py
 fc95aa7 
  
ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params.py
 fe00140 
  
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/params_linux.py
 f3643b1 
  
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/alerts/alert_metrics_deviation.py
 f0a1d5c 
  
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/params_linux.py
 37e2426 
  
ambari-server/src/main/resources/common-services/KAFKA/0.8.1/package/scripts/params.py
 d5451b2 
  
ambari-server/src/main/resources/common-services/STORM/0.9.1/package/scripts/params_linux.py
 d0ac3a4 
  
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/scripts/params.py
 699c51f 
  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 
7133c27 
  
ambari-server/src/main/resources/stacks/HDPWIN/2.1/hooks/before-START/scripts/params.py
 5bd2a9e 
  
ambari-server/src/test/java/org/apache/ambari/server/controller/internal/BlueprintConfigurationProcessorTest.java
 2c32f7c 
  
ambari-server/src/test/python/stacks/2.0.6/HDFS/test_alert_metrics_deviation.py 
5bfbfc6 
  ambari-server/src/test/python/stacks/2.0.6/configs/default.json 28624fd 
  ambari-server/src/test/python/stacks/2.0.6/configs/default_ams_embedded.json 
ceedb67 
  ambari-server/src/test/python/stacks/2.0.6/configs/default_hive_non_hdfs.json 
3692691 
  ambari-server/src/test/python/stacks/2.0.6/configs/default_with_bucket.json 
54172f3 
  ambari-server/src/test/python/stacks/2.2/common/test_stack_advisor.py 081a66a 
  
ambari-server/src/test/python/stacks/2.2/configs/journalnode-upgrade-hdfs-secure.json
 7b07d87 
  ambari-server/src/test/python/stacks/2.2/configs/journalnode-upgrade.json 
cf84bb7 
  ambari-server/src/test/python/stacks/2.2/configs/ranger-admin-upgrade.json 
6874db5 
  ambari-server/src/test/python/stacks/2.2/configs/ranger-usersync-upgrade.json 
0f5d647 
  ambari-server/src/test/python/stacks/2.3/configs/ats_1_5.json c64ca14 
  ambari-server/src/test/python/stacks/2.5/configs/hsi_default.json 78a0d04 
  
contrib/views/slider/src/main/java/org/apache/ambari/view/slider/SliderAppsViewControllerImpl.java
 42bd3ba 

Diff: https://reviews.apache.org/r/51207/diff/


Testing
---

Unit tests passed


Thanks,

Dmytro Sen

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

2016-08-18 Thread Dmytro Sen


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51143/#review146086
---


Ship it!




Ship It!

- Dmytro Sen


On Авг. 18, 2016, 3:35 п.п., Vitalyi Brodetskyi wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51143/
> ---
> 
> (Updated Авг. 18, 2016, 3:35 п.п.)
> 
> 
> Review request for Ambari, Andrew Onischuk, Dmitro Lisnichenko, Dmytro Sen, 
> Myroslav Papirkovskyy, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-18165
> https://issues.apache.org/jira/browse/AMBARI-18165
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> {code}
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 198, in 
> HbaseRegionServer().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 280, in execute
> method(env)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 720, in restart
> self.start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 124, in start
> self.post_start(env, upgrade_type=upgrade_type)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 89, in post_start
> self.apply_atlas_acl(params.hbase_user)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py",
>  line 114, in apply_atlas_acl
> shell.checked_call(format("{kinit_cmd}; {perm_cmd}"), 
> user=params.hbase_user, tries=10, try_sleep=10)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 71, in inner
> result = function(command, **kwargs)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 93, in checked_call
> tries=tries, try_sleep=try_sleep)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 141, in _call_wrapper
> result = _call(command, **kwargs_copy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 294, in _call
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of '/usr/bin/kinit -kt 
> /etc/security/keytabs/hbase.service.keytab 
> hbase/nat-r6-gjss-ambari-blueprints-4re-1-1.openstacklo...@example.com; echo 
> "grant 'atlas', 'RWXCA', 'atlas_titan'" | hbase shell -n' returned 1. 
>  Hortonworks #
> This is MOTD message, added for testing in qe infra
> ERROR ArgumentError: Can't find a table: atlas_titan
> {code}
> 
> 
> Diffs
> -
> 
>   
> ambari-common/src/main/python/resource_management/libraries/functions/constants.py
>  c5cbb3f 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata.py
>  7e9c0f6 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/metadata_server.py
>  43b8fb2 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/params.py
>  ab4af79 
>   
> ambari-server/src/main/resources/common-services/ATLAS/0.1.0.2.3/package/scripts/status_params.py
>  76575f6 
>   
> ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/scripts/hbase_regionserver.py
>  a22fe94 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_features.json
>  ed995b2 
>   ambari-server/src/main/resources/stacks/HDP/2.5/services/ATLAS/metainfo.xml 
> 4ba59d5 
>   ambari-server/src/test/python/stacks/2.0.6/HBASE/test_hbase_regionserver.py 
> a6c8e0f 
> 
> Diff: https://reviews.apache.org/r/51143/diff/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Vitalyi Brodetskyi
> 
>

Re: Review Request 51203: Doc updates about ldap sync related properties

2016-08-18 Thread Robert Nettleton


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51203/#review146074
---


Ship it!




Ship It!

- Robert Nettleton


On Aug. 18, 2016, 12:40 p.m., Oliver Szabo wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51203/
> ---
> 
> (Updated Aug. 18, 2016, 12:40 p.m.)
> 
> 
> Review request for Ambari, Jonathan Hurley, Laszlo Puskas, Sandor Magyari, 
> and Sebastian Toader.
> 
> 
> Bugs: AMBARI-18198
> https://issues.apache.org/jira/browse/AMBARI-18198
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> some markdown and javadoc updates about ldap sync related properties
> 
> 
> Diffs
> -
> 
>   ambari-server/docs/configuration/index.md 311def5 
>   
> ambari-server/src/main/java/org/apache/ambari/server/configuration/Configuration.java
>  8ab9091 
> 
> Diff: https://reviews.apache.org/r/51203/diff/
> 
> 
> Testing
> ---
> 
> done. used main() method of Configuration to generate the new index.md file
> 
> 
> Thanks,
> 
> Oliver Szabo
> 
>

Review Request 51203: Doc updates about ldap sync related properties

2016-08-18 Thread Oliver Szabo


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51203/
---

Review request for Ambari, Jonathan Hurley, Laszlo Puskas, Sandor Magyari, and 
Sebastian Toader.


Bugs: AMBARI-18198
https://issues.apache.org/jira/browse/AMBARI-18198


Repository: ambari


Description
---

some markdown and javadoc updates about ldap sync related properties


Diffs
-

  ambari-server/docs/configuration/index.md 311def5 
  
ambari-server/src/main/java/org/apache/ambari/server/configuration/Configuration.java
 8ab9091 

Diff: https://reviews.apache.org/r/51203/diff/


Testing
---

done. used main() method of Configuration to generate the new index.md file


Thanks,

Oliver Szabo

Re: Review Request 51189: Typo in stack_advisor.py for KAFKA

2016-08-18 Thread Di Li


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51189/#review146073
---


Ship it!




Ship It!

- Di Li


On Aug. 18, 2016, 5:45 a.m., Anita Jebaraj wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51189/
> ---
> 
> (Updated Aug. 18, 2016, 5:45 a.m.)
> 
> 
> Review request for Ambari, Di Li and Robert Levas.
> 
> 
> Bugs: AMBARI-18188
> https://issues.apache.org/jira/browse/AMBARI-18188
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> KAFKA is spelled as 'KAKFA' in stack_advisor.py because of which the function 
> validateKAFKAConfigurations will not be called
> 
> 
> Diffs
> -
> 
>   ambari-server/src/main/resources/stacks/HDP/2.3/services/stack_advisor.py 
> a0cce7b 
> 
> Diff: https://reviews.apache.org/r/51189/diff/
> 
> 
> Testing
> ---
> 
> Ran mvn test
> 
> 
> Thanks,
> 
> Anita Jebaraj
> 
>

Review Request 51201: Generate REST API docs with Swagger for Log Search

2016-08-18 Thread Oliver Szabo


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51201/
---

Review request for Ambari, Dharmesh Makwana, Miklos Gergely, Robert Nettleton, 
and Sumit Mohanty.


Bugs: AMBARI-18196
https://issues.apache.org/jira/browse/AMBARI-18196


Repository: ambari


Description
---

- generate rest api doc with swagger
- changed the root endpoint mapping form /service/* to /api/v1
- currently I using implicit params for the endpoint, but the after i will 
rework the rest API, i expect to use objects instead of that (if swagger 
supports not primitive types for queries) ... there i will update the endpoints 
that ambari uses as well
- i created a lot of empty descriptions, we will fill that later (im not sure 
about: what some query parameters do or do we need them anyway, etc.)


Diffs
-

  ambari-logsearch/ambari-logsearch-it/pom.xml 075a22a 
  ambari-logsearch/ambari-logsearch-portal/pom.xml 7a46fe5 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/LogSearch.java
 819d3b9 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/doc/DocConstants.java
 PRE-CREATION 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/rest/AuditREST.java
 6d18b4a 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/rest/DashboardREST.java
 cb87f6f 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/rest/LogFileREST.java
 ef1bb8f 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/rest/PublicREST.java
 7977703 
  
ambari-logsearch/ambari-logsearch-portal/src/main/java/org/apache/ambari/logsearch/rest/UserConfigREST.java
 40b215c 
  
ambari-logsearch/ambari-logsearch-portal/src/main/webapp/META-INF/applicationContext.xml
 5e24d88 
  
ambari-logsearch/ambari-logsearch-portal/src/main/webapp/META-INF/security-applicationContext.xml
 96852b5 
  ambari-logsearch/ambari-logsearch-portal/src/main/webapp/WEB-INF/web.xml 
dc8519a 
  ambari-logsearch/ambari-logsearch-portal/src/main/webapp/login.html ff546ef 
  ambari-logsearch/ambari-logsearch-portal/src/main/webapp/scripts/App.js 
ef9b662 
  
ambari-logsearch/ambari-logsearch-portal/src/main/webapp/scripts/utils/Globals.js
 212846b 
  
ambari-logsearch/ambari-logsearch-portal/src/main/webapp/scripts/views/audit/AuditAggregatedView.js
 acca51c 
  
ambari-logsearch/ambari-logsearch-portal/src/main/webapp/scripts/views/tabs/LogFileView.js
 6932355 
  
ambari-logsearch/ambari-logsearch-portal/src/main/webapp/templates/helpers/Helpers.js
 2117aa3 

Diff: https://reviews.apache.org/r/51201/diff/


Testing
---

testing done.


Thanks,

Oliver Szabo

Re: Review Request 51199: Hsi-Hs2: Mondrian tests intermittently fail with "java.io.IOException: Connection reset by peer"

2016-08-18 Thread Vitalyi Brodetskyi


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51199/#review146072
---


Ship it!




Ship It!

- Vitalyi Brodetskyi


On Сер. 18, 2016, 9:28 до полудня, Andrew Onischuk wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51199/
> ---
> 
> (Updated Сер. 18, 2016, 9:28 до полудня)
> 
> 
> Review request for Ambari and Vitalyi Brodetskyi.
> 
> 
> Bugs: AMBARI-18194
> https://issues.apache.org/jira/browse/AMBARI-18194
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py
>  33006e1 
>   
> ambari-server/src/main/resources/stacks/HDP/2.3/services/HDFS/configuration/hadoop-env.xml
>  89c26a5 
> 
> Diff: https://reviews.apache.org/r/51199/diff/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Andrew Onischuk
> 
>

Review Request 51198: Hsi-Hs2: Mondrian tests intermittently fail with "java.io.IOException: Connection reset by peer"

2016-08-18 Thread Andrew Onischuk


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51198/
---

Review request for Ambari and Vitalyi Brodetskyi.


Bugs: AMBARI-18194
https://issues.apache.org/jira/browse/AMBARI-18194


Repository: ambari


Description
---

I'd reported this issue previously in
not see this due to its intermitent nature.  
In yesterdays nightly, around 8 tests had failed with this issue and on rerun
48 failed. Hs2 logs are below:




2016-08-17T07:28:55,479 INFO  [HiveServer2-Background-Pool: Thread-6508]: 
SessionState (SessionState.java:printInfo(1075)) - Status: Running (Executing 
on YARN cluster with App id application_1471417242320_0006)

Map 1: 1/1  Reducer 2: 0(+1)/1  Reducer 3: 0/1
2016-08-17T07:28:55,480 INFO  [HiveServer2-Background-Pool: Thread-6508]: 
SessionState (SessionState.java:printInfo(1075)) - Map 1: 1/1 Reducer 2: 
0(+1)/1  Reducer 3: 0/1
Map 1: 1/1  Reducer 2: 1/1  Reducer 3: 0(+1)/1
2016-08-17T07:28:55,681 INFO  [HiveServer2-Background-Pool: Thread-6508]: 
SessionState (SessionState.java:printInfo(1075)) - Map 1: 1/1 Reducer 2: 1/1  
Reducer 3: 0(+1)/1
Map 1: 1/1  Reducer 2: 1/1  Reducer 3: 0(+1,-2)/1
2016-08-17T07:28:58,422 INFO  [HiveServer2-Background-Pool: Thread-6503]: 
SessionState (SessionState.java:printInfo(1075)) - Map 1: 1/1 Reducer 2: 1/1  
Reducer 3: 0(+1,-2)/1
Map 1: 1/1  Reducer 2: 1/1  Reducer 3: 0(+1,-1)/1
2016-08-17T07:28:58,422 INFO  [HiveServer2-Background-Pool: Thread-6507]: 
SessionState (SessionState.java:printInfo(1075)) - Map 1: 1/1 Reducer 2: 1/1  
Reducer 3: 0(+1,-1)/1
Map 1: 1/1  Reducer 2: 1/1  Reducer 3: 0(+1)/1
2016-08-17T07:28:58,955 INFO  [HiveServer2-Background-Pool: Thread-6508]: 
SessionState (SessionState.java:printInfo(1075)) - Map 1: 1/1 Reducer 2: 1/1  
Reducer 3: 0(+1)/1
Map 1: 1/1  Reducer 2: 1/1  Reducer 3: 0(+1,-1)/1
2016-08-17T07:29:00,566 INFO  [HiveServer2-Background-Pool: Thread-6508]: 
SessionState (SessionState.java:printInfo(1075)) - Map 1: 1/1 Reducer 2: 1/1  
Reducer 3: 0(+1,-1)/1
Map 1: 1/1  Reducer 2: 1/1  Reducer 3: 0(+1,-3)/1
2016-08-17T07:29:00,633 INFO  [HiveServer2-Background-Pool: Thread-6503]: 
SessionState (SessionState.java:printInfo(1075)) - Map 1: 1/1 Reducer 2: 1/1  
Reducer 3: 0(+1,-3)/1
Map 1: 1/1  Reducer 2: 1/1  Reducer 3: 0(+1,-2)/1
2016-08-17T07:29:00,635 INFO  [HiveServer2-Background-Pool: Thread-6507]: 
SessionState (SessionState.java:printInfo(1075)) - Map 1: 1/1 Reducer 2: 1/1  
Reducer 3: 0(+1,-2)/1
Status: Failed
2016-08-17T07:29:00,708 ERROR [HiveServer2-Background-Pool: Thread-6503]: 
SessionState (SessionState.java:printError(1084)) - Status: Failed
Vertex failed, vertexName=Reducer 3, 
vertexId=vertex_1471417242320_0005_293_02, diagnostics=[Task failed, 
taskId=task_1471417242320_0005_293_02_00, diagnostics=[TaskAttempt 0 
failed, info=[Error: Error while running task ( failure ) : 
attempt_1471417242320_0005_293_02_00_0:java.lang.RuntimeException: 
java.lang.RuntimeException: Hive Runtime Error while closing operators: 
java.io.IOException: Connection reset by peer
at 
org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:211)
at 
org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:168)
at 
org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:370)
at 
org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:73)
at 
org.apache.tez.runtime.task.TaskRunner2Callable$1.run(TaskRunner2Callable.java:61)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
at 
org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:61)
at 
org.apache.tez.runtime.task.TaskRunner2Callable.callInternal(TaskRunner2Callable.java:37)
at 
org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
at 
org.apache.hadoop.hive.llap.daemon.impl.StatsRecordingThreadPool$WrappedCallable.call(StatsRecordingThreadPool.java:110)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.RuntimeException: Hive Runtime Error while closing 
operators: java.io.IOException: Connection reset by peer
at

Re: Review Request 51197: Zeppelin logsearch configuration typo

2016-08-18 Thread Oliver Szabo


---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/51197/#review146071
---


Ship it!




Ship It!

- Oliver Szabo


On Aug. 18, 2016, 9:19 a.m., Miklos Gergely wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/51197/
> ---
> 
> (Updated Aug. 18, 2016, 9:19 a.m.)
> 
> 
> Review request for Ambari, Oliver Szabo, Robert Nettleton, and Sumit Mohanty.
> 
> 
> Bugs: AMBARI-18193
> https://issues.apache.org/jira/browse/AMBARI-18193
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> an s was missing
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/package/scripts/params.py
>  cb7b79f 
> 
> Diff: https://reviews.apache.org/r/51197/diff/
> 
> 
> Testing
> ---
> 
> 
> Thanks,
> 
> Miklos Gergely
> 
>

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

Re: Review Request 50047: Kafka listeners property does not show SASL_PLAINTEXT protocol when Kerberos is enabled

Review Request 51222: RU, order Kafka right after Ranger and before HDFS in upgrade pack

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

Review Request 51207: Wrong hostname in timeline.metrics.service.webapp.address breaks AMS HA

Re: Review Request 51143: Alert on Atlas after adding it to a secure cluster as HBase table initialization fails

Re: Review Request 51203: Doc updates about ldap sync related properties

Review Request 51203: Doc updates about ldap sync related properties

Re: Review Request 51189: Typo in stack_advisor.py for KAFKA

Review Request 51201: Generate REST API docs with Swagger for Log Search

Re: Review Request 51199: Hsi-Hs2: Mondrian tests intermittently fail with "java.io.IOException: Connection reset by peer"

Review Request 51198: Hsi-Hs2: Mondrian tests intermittently fail with "java.io.IOException: Connection reset by peer"

Re: Review Request 51197: Zeppelin logsearch configuration typo

20 matches

Site Navigation

Mail list logo

Footer information