Re: Review Request 48683: One of RM failed to start after ambaru upgrade in secure cluster [Upgrade]

2016-06-14 Thread Alejandro Fernandez 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/48683/#review137631
---




ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py
 (line 241)


What guarantees that hdfs keytab will be on the RM host?


- Alejandro Fernandez


On June 14, 2016, 10:59 a.m., Andrew Onischuk wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/48683/
> ---
> 
> (Updated June 14, 2016, 10:59 a.m.)
> 
> 
> Review request for Ambari and Dmitro Lisnichenko.
> 
> 
> Bugs: AMBARI-17216
> https://issues.apache.org/jira/browse/AMBARI-17216
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> STR:
> 
>   1. Deploy HDP 2.4 on Ambari2.2.2.0
>   2. Enable NN and RM HAs
>   3. Enable security
>   4. Perform ambari upgrade to 2.4.0
> 
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
>  line 287, in 
> Resourcemanager().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 257, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
>  line 124, in start
> 
> self.wait_for_dfs_directories_created(params.entity_groupfs_store_dir, 
> params.entity_groupfs_active_dir)
>   File 
> "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
>  line 244, in wait_for_dfs_directories_created
> self.wait_for_dfs_directory_created(dir_path, ignored_dfs_dirs)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/decorator.py",
>  line 55, in wrapper
> return function(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
>  line 266, in wait_for_dfs_directory_created
> list_status = util.run_command(dir_path, 'GETFILESTATUS', 
> method='GET', ignore_status_codes=['404'], assertable_result=False)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py",
>  line 191, in run_command
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of 'curl -sS -L -w 
> '%{http_code}' -X GET --negotiate -u : 
> 'http://os-r6-kdfyi-nat-s-ru242to25rhel6secha-12.openstacklocal:50070/webhdfs/v1/ats/done/?op=GETFILESTATUS=hdfs''
>  returned status_code=401. 
> 
> 
> 
> Error 401 Authentication required
> 
> HTTP ERROR 401
> Problem accessing /webhdfs/v1/ats/done/. Reason:
> Authentication requiredPowered by 
> Jetty://
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py
>  0b80dc6 
> 
> Diff: https://reviews.apache.org/r/48683/diff/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Andrew Onischuk
> 
>

Re: Review Request 48683: One of RM failed to start after ambaru upgrade in secure cluster [Upgrade]

2016-06-14 Thread Dmitro Lisnichenko 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/48683/#review137482
---


Ship it!




Ship It!

- Dmitro Lisnichenko


On June 14, 2016, 1:59 p.m., Andrew Onischuk wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/48683/
> ---
> 
> (Updated June 14, 2016, 1:59 p.m.)
> 
> 
> Review request for Ambari and Dmitro Lisnichenko.
> 
> 
> Bugs: AMBARI-17216
> https://issues.apache.org/jira/browse/AMBARI-17216
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> STR:
> 
>   1. Deploy HDP 2.4 on Ambari2.2.2.0
>   2. Enable NN and RM HAs
>   3. Enable security
>   4. Perform ambari upgrade to 2.4.0
> 
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
>  line 287, in 
> Resourcemanager().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 257, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
>  line 124, in start
> 
> self.wait_for_dfs_directories_created(params.entity_groupfs_store_dir, 
> params.entity_groupfs_active_dir)
>   File 
> "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
>  line 244, in wait_for_dfs_directories_created
> self.wait_for_dfs_directory_created(dir_path, ignored_dfs_dirs)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/decorator.py",
>  line 55, in wrapper
> return function(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
>  line 266, in wait_for_dfs_directory_created
> list_status = util.run_command(dir_path, 'GETFILESTATUS', 
> method='GET', ignore_status_codes=['404'], assertable_result=False)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py",
>  line 191, in run_command
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of 'curl -sS -L -w 
> '%{http_code}' -X GET --negotiate -u : 
> 'http://os-r6-kdfyi-nat-s-ru242to25rhel6secha-12.openstacklocal:50070/webhdfs/v1/ats/done/?op=GETFILESTATUS=hdfs''
>  returned status_code=401. 
> 
> 
> 
> Error 401 Authentication required
> 
> HTTP ERROR 401
> Problem accessing /webhdfs/v1/ats/done/. Reason:
> Authentication requiredPowered by 
> Jetty://
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py
>  0b80dc6 
> 
> Diff: https://reviews.apache.org/r/48683/diff/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Andrew Onischuk
> 
>

Re: Review Request 48683: One of RM failed to start after ambaru upgrade in secure cluster [Upgrade]

2016-06-14 Thread Andrew Onischuk 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/48683/
---

(Updated June 14, 2016, 10:59 a.m.)


Review request for Ambari and Dmitro Lisnichenko.


Bugs: AMBARI-17216
https://issues.apache.org/jira/browse/AMBARI-17216


Repository: ambari


Description
---

STR:

  1. Deploy HDP 2.4 on Ambari2.2.2.0
  2. Enable NN and RM HAs
  3. Enable security
  4. Perform ambari upgrade to 2.4.0

Traceback (most recent call last):
  File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
 line 287, in 
Resourcemanager().execute()
  File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 257, in execute
method(env)
  File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
 line 124, in start
self.wait_for_dfs_directories_created(params.entity_groupfs_store_dir, 
params.entity_groupfs_active_dir)
  File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
 line 244, in wait_for_dfs_directories_created
self.wait_for_dfs_directory_created(dir_path, ignored_dfs_dirs)
  File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/decorator.py",
 line 55, in wrapper
return function(*args, **kwargs)
  File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
 line 266, in wait_for_dfs_directory_created
list_status = util.run_command(dir_path, 'GETFILESTATUS', method='GET', 
ignore_status_codes=['404'], assertable_result=False)
  File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py",
 line 191, in run_command
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of 'curl -sS -L -w 
'%{http_code}' -X GET --negotiate -u : 
'http://os-r6-kdfyi-nat-s-ru242to25rhel6secha-12.openstacklocal:50070/webhdfs/v1/ats/done/?op=GETFILESTATUS=hdfs''
 returned status_code=401. 



Error 401 Authentication required

HTTP ERROR 401
Problem accessing /webhdfs/v1/ats/done/. Reason:
Authentication requiredPowered by 
Jetty://


Diffs (updated)
-

  
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py
 0b80dc6 

Diff: https://reviews.apache.org/r/48683/diff/


Testing
---

mvn clean test


Thanks,

Andrew Onischuk

Re: Review Request 48683: One of RM failed to start after ambaru upgrade in secure cluster [Upgrade]

2016-06-14 Thread Dmitro Lisnichenko 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/48683/#review137479
---


Ship it!




Ship It!

- Dmitro Lisnichenko


On June 14, 2016, 1:49 p.m., Andrew Onischuk wrote:
> 
> ---
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/48683/
> ---
> 
> (Updated June 14, 2016, 1:49 p.m.)
> 
> 
> Review request for Ambari and Dmitro Lisnichenko.
> 
> 
> Bugs: AMBARI-17216
> https://issues.apache.org/jira/browse/AMBARI-17216
> 
> 
> Repository: ambari
> 
> 
> Description
> ---
> 
> STR:
> 
>   1. Deploy HDP 2.4 on Ambari2.2.2.0
>   2. Enable NN and RM HAs
>   3. Enable security
>   4. Perform ambari upgrade to 2.4.0
> 
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
>  line 287, in 
> Resourcemanager().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 257, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
>  line 124, in start
> 
> self.wait_for_dfs_directories_created(params.entity_groupfs_store_dir, 
> params.entity_groupfs_active_dir)
>   File 
> "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
>  line 244, in wait_for_dfs_directories_created
> self.wait_for_dfs_directory_created(dir_path, ignored_dfs_dirs)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/decorator.py",
>  line 55, in wrapper
> return function(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
>  line 266, in wait_for_dfs_directory_created
> list_status = util.run_command(dir_path, 'GETFILESTATUS', 
> method='GET', ignore_status_codes=['404'], assertable_result=False)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py",
>  line 191, in run_command
> raise Fail(err_msg)
> resource_management.core.exceptions.Fail: Execution of 'curl -sS -L -w 
> '%{http_code}' -X GET --negotiate -u : 
> 'http://os-r6-kdfyi-nat-s-ru242to25rhel6secha-12.openstacklocal:50070/webhdfs/v1/ats/done/?op=GETFILESTATUS=hdfs''
>  returned status_code=401. 
> 
> 
> 
> Error 401 Authentication required
> 
> HTTP ERROR 401
> Problem accessing /webhdfs/v1/ats/done/. Reason:
> Authentication requiredPowered by 
> Jetty://
> 
> 
> Diffs
> -
> 
>   
> ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py
>  0b80dc6 
> 
> Diff: https://reviews.apache.org/r/48683/diff/
> 
> 
> Testing
> ---
> 
> mvn clean test
> 
> 
> Thanks,
> 
> Andrew Onischuk
> 
>

Re: Review Request 48683: One of RM failed to start after ambaru upgrade in secure cluster [Upgrade]

2016-06-14 Thread Andrew Onischuk 

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/48683/
---

(Updated June 14, 2016, 10:49 a.m.)


Review request for Ambari and Dmitro Lisnichenko.


Bugs: AMBARI-17216
https://issues.apache.org/jira/browse/AMBARI-17216


Repository: ambari


Description (updated)
---

STR:

  1. Deploy HDP 2.4 on Ambari2.2.2.0
  2. Enable NN and RM HAs
  3. Enable security
  4. Perform ambari upgrade to 2.4.0

Traceback (most recent call last):
  File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
 line 287, in 
Resourcemanager().execute()
  File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
 line 257, in execute
method(env)
  File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
 line 124, in start
self.wait_for_dfs_directories_created(params.entity_groupfs_store_dir, 
params.entity_groupfs_active_dir)
  File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
 line 244, in wait_for_dfs_directories_created
self.wait_for_dfs_directory_created(dir_path, ignored_dfs_dirs)
  File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/functions/decorator.py",
 line 55, in wrapper
return function(*args, **kwargs)
  File 
"/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py",
 line 266, in wait_for_dfs_directory_created
list_status = util.run_command(dir_path, 'GETFILESTATUS', method='GET', 
ignore_status_codes=['404'], assertable_result=False)
  File 
"/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py",
 line 191, in run_command
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of 'curl -sS -L -w 
'%{http_code}' -X GET --negotiate -u : 
'http://os-r6-kdfyi-nat-s-ru242to25rhel6secha-12.openstacklocal:50070/webhdfs/v1/ats/done/?op=GETFILESTATUS=hdfs''
 returned status_code=401. 



Error 401 Authentication required

HTTP ERROR 401
Problem accessing /webhdfs/v1/ats/done/. Reason:
Authentication requiredPowered by 
Jetty://


Diffs
-

  
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py
 0b80dc6 

Diff: https://reviews.apache.org/r/48683/diff/


Testing
---

mvn clean test


Thanks,

Andrew Onischuk