[jira] [Commented] (AMBARI-19438) Add enable delta sync property for Ranger

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837340#comment-15837340
 ] 

Hudson commented on AMBARI-19438:
-

SUCCESS: Integrated in Jenkins build Ambari-trunk-Commit #6537 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/6537/])
AMBARI-19438 Add enable delta sync property for Ranger (mugdha) (mugdha: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=ff4babbb776b6f7f53003a499d8677c9d79b5404])
* (add) 
ambari-server/src/main/resources/common-services/RANGER/0.7.0/themes/theme_version_5.json
* (add) 
ambari-server/src/main/resources/common-services/RANGER/0.7.0/configuration/ranger-ugsync-site.xml
* (edit) 
ambari-server/src/main/resources/common-services/RANGER/0.7.0/metainfo.xml


> Add enable delta sync property for Ranger
> -
>
> Key: AMBARI-19438
> URL: https://issues.apache.org/jira/browse/AMBARI-19438
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 2.5.0
>Reporter: Mugdha Varadkar
>Assignee: Mugdha Varadkar
> Fix For: 2.5.0
>
> Attachments: AMBARI-19438.patch
>
>
> Add new property {{ranger.usersync.ldap.deltasync}} under ranger-ugsync-site 
> config type to enable delta-sync. Need to show it under existing Smart Config 
> Tab Ranger Usersync for LDAP/AD Sub Tab.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19438) Add enable delta sync property for Ranger

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837332#comment-15837332
 ] 

Hudson commented on AMBARI-19438:
-

SUCCESS: Integrated in Jenkins build Ambari-branch-2.5 #795 (See 
[https://builds.apache.org/job/Ambari-branch-2.5/795/])
AMBARI-19438 Add enable delta sync property for Ranger (mugdha) (mugdha: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=3fe36a45799cd24e638e9a0764aaa64cc08cbaff])
* (add) 
ambari-server/src/main/resources/common-services/RANGER/0.7.0/themes/theme_version_5.json
* (add) 
ambari-server/src/main/resources/common-services/RANGER/0.7.0/configuration/ranger-ugsync-site.xml
* (edit) 
ambari-server/src/main/resources/common-services/RANGER/0.7.0/metainfo.xml


> Add enable delta sync property for Ranger
> -
>
> Key: AMBARI-19438
> URL: https://issues.apache.org/jira/browse/AMBARI-19438
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 2.5.0
>Reporter: Mugdha Varadkar
>Assignee: Mugdha Varadkar
> Fix For: 2.5.0
>
> Attachments: AMBARI-19438.patch
>
>
> Add new property {{ranger.usersync.ldap.deltasync}} under ranger-ugsync-site 
> config type to enable delta-sync. Need to show it under existing Smart Config 
> Tab Ranger Usersync for LDAP/AD Sub Tab.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19603) Issue with delete action node operation

2017-01-24 Thread Belliraj HB (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Belliraj HB updated AMBARI-19603:
-
Assignee: Belliraj HB
  Status: Patch Available  (was: Open)

> Issue with delete action node operation
> ---
>
> Key: AMBARI-19603
> URL: https://issues.apache.org/jira/browse/AMBARI-19603
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-views
>Affects Versions: 2.5.0
>Reporter: Supreeth Sharma
>Assignee: Belliraj HB
>Priority: Critical
>  Labels: WFD
> Fix For: 2.5.0
>
> Attachments: AMBARI-19603_trunk.patch
>
>
> Deleting decision node is deleting every other node proceeding it.
> Steps to reproduce :
> 1) Import the the workflow with decision node
> 2) Delete the decision node.
> 3) See that even the end node is getting deleted.
> Options



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19603) Issue with delete action node operation

2017-01-24 Thread Belliraj HB (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Belliraj HB updated AMBARI-19603:
-
Attachment: AMBARI-19603_trunk.patch

> Issue with delete action node operation
> ---
>
> Key: AMBARI-19603
> URL: https://issues.apache.org/jira/browse/AMBARI-19603
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-views
>Affects Versions: 2.5.0
>Reporter: Supreeth Sharma
>Priority: Critical
>  Labels: WFD
> Fix For: 2.5.0
>
> Attachments: AMBARI-19603_trunk.patch
>
>
> Deleting decision node is deleting every other node proceeding it.
> Steps to reproduce :
> 1) Import the the workflow with decision node
> 2) Delete the decision node.
> 3) See that even the end node is getting deleted.
> Options



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19438) Add enable delta sync property for Ranger

2017-01-24 Thread Mugdha Varadkar (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mugdha Varadkar updated AMBARI-19438:
-
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Committed to branch-2.5: 
[3fe36a45799cd24e638e9a0764aaa64cc08cbaff|https://github.com/apache/ambari/commit/3fe36a45799cd24e638e9a0764aaa64cc08cbaff]
 and trunk: 
[ff4babbb776b6f7f53003a499d8677c9d79b5404|https://github.com/apache/ambari/commit/ff4babbb776b6f7f53003a499d8677c9d79b5404]

> Add enable delta sync property for Ranger
> -
>
> Key: AMBARI-19438
> URL: https://issues.apache.org/jira/browse/AMBARI-19438
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 2.5.0
>Reporter: Mugdha Varadkar
>Assignee: Mugdha Varadkar
> Fix For: 2.5.0
>
> Attachments: AMBARI-19438.patch
>
>
> Add new property {{ranger.usersync.ldap.deltasync}} under ranger-ugsync-site 
> config type to enable delta-sync. Need to show it under existing Smart Config 
> Tab Ranger Usersync for LDAP/AD Sub Tab.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19667) Hive View 2.0: Editor should be stretchable by dragging

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837204#comment-15837204
 ] 

Hudson commented on AMBARI-19667:
-

SUCCESS: Integrated in Jenkins build Ambari-branch-2.5 #794 (See 
[https://builds.apache.org/job/Ambari-branch-2.5/794/])
AMBARI-19667. Hive View 2.0: Editor should be stretchable by dragging 
(pallavkul: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=a5e008067ec31e526bd86d6efd80c3874a531711])
* (edit) contrib/views/hive20/src/main/resources/ui/bower.json
* (edit) 
contrib/views/hive20/src/main/resources/ui/app/components/query-editor.js
* (edit) contrib/views/hive20/src/main/resources/ui/package.json
* (edit) contrib/views/hive20/src/main/resources/ui/app/styles/app.scss


> Hive View 2.0: Editor should be stretchable by dragging
> ---
>
> Key: AMBARI-19667
> URL: https://issues.apache.org/jira/browse/AMBARI-19667
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-views
>Affects Versions: 2.5.0
>Reporter: Abhishek Kumar
>Assignee: Abhishek Kumar
> Fix For: 2.5.0
>
> Attachments: AMBARI-19667_trunk.patch
>
>
> User should be able to extend the height of editor by dragging



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Assigned] (AMBARI-17589) Capture & visualize metrics for Ambari Server

2017-01-24 Thread Aravindan Vijayan (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aravindan Vijayan reassigned AMBARI-17589:
--

Assignee: Aravindan Vijayan  (was: Li-Wei Tseng)

> Capture & visualize metrics for Ambari Server
> -
>
> Key: AMBARI-17589
> URL: https://issues.apache.org/jira/browse/AMBARI-17589
> Project: Ambari
>  Issue Type: Epic
>  Components: ambari-metrics, ambari-server
>Affects Versions: 2.5.0
>Reporter: Aravindan Vijayan
>Assignee: Aravindan Vijayan
>Priority: Critical
> Fix For: 2.5.0
>
>
> Ambari's architectural design is based on having a single master server with 
> multiple agents.  Each agent sends a heartbeat every X seconds to the server 
> to report its status; the server may reply with a list of commands to be run 
> by each agent.
> An operational cluster may have up to 2000-4000 agents and Ambari needs to be 
> robust and performant at such scale.  Often times, Ambari's overall 
> performance is subject to the cluster’s environment like network latency and 
> stability, Ambari database call latency, etc. In such environments, detecting 
> the cause of the Ambari’s sluggish performance and/or instability have proven 
> to be difficult in practice.
> Ambari should intercept and store the time and resources taken for serving 
> requests.  This information can be then presented to the end user on Ambari 
> Web and/or Grafana. 
> Optionally, this work can be extended to have Ambari Web persist time taken 
> to process the response of each API call and other performance 
> characteristics.  Such performance data on Ambari Web can be again presented 
> to the end user via Ambari Web and/or Grafana. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (AMBARI-17589) Capture & visualize metrics for Ambari Server

2017-01-24 Thread Aravindan Vijayan (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-17589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aravindan Vijayan resolved AMBARI-17589.

Resolution: Fixed

> Capture & visualize metrics for Ambari Server
> -
>
> Key: AMBARI-17589
> URL: https://issues.apache.org/jira/browse/AMBARI-17589
> Project: Ambari
>  Issue Type: Epic
>  Components: ambari-metrics, ambari-server
>Affects Versions: 2.5.0
>Reporter: Aravindan Vijayan
>Assignee: Li-Wei Tseng
>Priority: Critical
> Fix For: 2.5.0
>
>
> Ambari's architectural design is based on having a single master server with 
> multiple agents.  Each agent sends a heartbeat every X seconds to the server 
> to report its status; the server may reply with a list of commands to be run 
> by each agent.
> An operational cluster may have up to 2000-4000 agents and Ambari needs to be 
> robust and performant at such scale.  Often times, Ambari's overall 
> performance is subject to the cluster’s environment like network latency and 
> stability, Ambari database call latency, etc. In such environments, detecting 
> the cause of the Ambari’s sluggish performance and/or instability have proven 
> to be difficult in practice.
> Ambari should intercept and store the time and resources taken for serving 
> requests.  This information can be then presented to the end user on Ambari 
> Web and/or Grafana. 
> Optionally, this work can be extended to have Ambari Web persist time taken 
> to process the response of each API call and other performance 
> characteristics.  Such performance data on Ambari Web can be again presented 
> to the end user via Ambari Web and/or Grafana. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19701) Provide minimal call context from UI when making stack advisor calls

2017-01-24 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837179#comment-15837179
 ] 

Hadoop QA commented on AMBARI-19701:


{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12849212/AMBARI-19701.patch
  against trunk revision .

{color:red}-1 patch{color}.  The patch command could not apply the patch.

Console output: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10237//console

This message is automatically generated.

> Provide minimal call context from UI when making stack advisor calls
> 
>
> Key: AMBARI-19701
> URL: https://issues.apache.org/jira/browse/AMBARI-19701
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Richard Zang
>Assignee: Richard Zang
> Fix For: 2.5.0
>
> Attachments: AMBARI-19701.patch
>
>
> We need to identify if call is made when
> * Cluster is being created (first call)
> * Add service
> * Just landing on a page and only need config attributes
> Possible change to the json data send in POST - 
> {code}
> {
> "recommend":"configurations",
>  "user-context" : { "operation" : "ClusterCreate" } <== add this
> "hosts"
> {code}
> *Cluster create (first call):*
> {code}"user-context": {"operation" : "ClusterCreate"}{code}
> *Add service (first call):*
> {code}"user-context": {"operation" : "AddService", "operation_details" : 
> "HDFS,YARN"}{code}
> *Landing on a config page:*
> {code}"user-context": {"operation" : "RecommendAttribute"}{code}
> *Config edit on a config page: (lower priority)*
> {code}"user-context": {"operation" : "EditConfig"}{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19671) Hive View 2.0: Incorrect behaviour on select of database

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837171#comment-15837171
 ] 

Hudson commented on AMBARI-19671:
-

SUCCESS: Integrated in Jenkins build Ambari-trunk-Commit #6536 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/6536/])
AMBARI-19671. Hive View 2.0: Incorrect behaviour on select of database 
(pallavkul: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=72e02ab089b07246b2c79eb5e94825f1c19ad3cf])
* (edit) 
contrib/views/hive20/src/main/resources/ui/app/templates/queries/query.hbs


> Hive View 2.0: Incorrect behaviour on select of database
> 
>
> Key: AMBARI-19671
> URL: https://issues.apache.org/jira/browse/AMBARI-19671
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-views
>Affects Versions: 2.5.0
>Reporter: Abhishek Kumar
>Assignee: Abhishek Kumar
> Fix For: 2.5.0
>
> Attachments: AMBARI-19671_trunk.patch
>
>
> On selecting a database from right panel, display does not change. Ideally 
> followings should happen:
> 1. Move "checked" icon to selected database
> 2. Hide tables related to unselected database and show tables for the 
> selected one.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19671) Hive View 2.0: Incorrect behaviour on select of database

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837169#comment-15837169
 ] 

Hudson commented on AMBARI-19671:
-

SUCCESS: Integrated in Jenkins build Ambari-branch-2.5 #793 (See 
[https://builds.apache.org/job/Ambari-branch-2.5/793/])
AMBARI-19671. Hive View 2.0: Incorrect behaviour on select of database 
(pallavkul: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=5c9fc2e5d53435daca736cced9af94e5b009e993])
* (edit) 
contrib/views/hive20/src/main/resources/ui/app/templates/queries/query.hbs


> Hive View 2.0: Incorrect behaviour on select of database
> 
>
> Key: AMBARI-19671
> URL: https://issues.apache.org/jira/browse/AMBARI-19671
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-views
>Affects Versions: 2.5.0
>Reporter: Abhishek Kumar
>Assignee: Abhishek Kumar
> Fix For: 2.5.0
>
> Attachments: AMBARI-19671_trunk.patch
>
>
> On selecting a database from right panel, display does not change. Ideally 
> followings should happen:
> 1. Move "checked" icon to selected database
> 2. Hide tables related to unselected database and show tables for the 
> selected one.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19667) Hive View 2.0: Editor should be stretchable by dragging

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837170#comment-15837170
 ] 

Hudson commented on AMBARI-19667:
-

SUCCESS: Integrated in Jenkins build Ambari-trunk-Commit #6536 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/6536/])
AMBARI-19667. Hive View 2.0: Editor should be stretchable by dragging 
(pallavkul: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=0de31d6a59c2ec847fc060dffb9e69431eee4ebc])
* (edit) 
contrib/views/hive20/src/main/resources/ui/app/components/query-editor.js
* (edit) contrib/views/hive20/src/main/resources/ui/app/styles/app.scss
* (edit) contrib/views/hive20/src/main/resources/ui/package.json
* (edit) contrib/views/hive20/src/main/resources/ui/bower.json


> Hive View 2.0: Editor should be stretchable by dragging
> ---
>
> Key: AMBARI-19667
> URL: https://issues.apache.org/jira/browse/AMBARI-19667
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-views
>Affects Versions: 2.5.0
>Reporter: Abhishek Kumar
>Assignee: Abhishek Kumar
> Fix For: 2.5.0
>
> Attachments: AMBARI-19667_trunk.patch
>
>
> User should be able to extend the height of editor by dragging



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19667) Hive View 2.0: Editor should be stretchable by dragging

2017-01-24 Thread Pallav Kulshreshtha (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pallav Kulshreshtha updated AMBARI-19667:
-
Resolution: Fixed
Status: Resolved  (was: Patch Available)

committed to trunk and branch-2.5

> Hive View 2.0: Editor should be stretchable by dragging
> ---
>
> Key: AMBARI-19667
> URL: https://issues.apache.org/jira/browse/AMBARI-19667
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-views
>Affects Versions: 2.5.0
>Reporter: Abhishek Kumar
>Assignee: Abhishek Kumar
> Fix For: 2.5.0
>
> Attachments: AMBARI-19667_trunk.patch
>
>
> User should be able to extend the height of editor by dragging



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19671) Hive View 2.0: Incorrect behaviour on select of database

2017-01-24 Thread Pallav Kulshreshtha (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Pallav Kulshreshtha updated AMBARI-19671:
-
Resolution: Fixed
Status: Resolved  (was: Patch Available)

committed to trunk and branch-2.5

> Hive View 2.0: Incorrect behaviour on select of database
> 
>
> Key: AMBARI-19671
> URL: https://issues.apache.org/jira/browse/AMBARI-19671
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-views
>Affects Versions: 2.5.0
>Reporter: Abhishek Kumar
>Assignee: Abhishek Kumar
> Fix For: 2.5.0
>
> Attachments: AMBARI-19671_trunk.patch
>
>
> On selecting a database from right panel, display does not change. Ideally 
> followings should happen:
> 1. Move "checked" icon to selected database
> 2. Hide tables related to unselected database and show tables for the 
> selected one.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19701) Provide minimal call context from UI when making stack advisor calls

2017-01-24 Thread Richard Zang (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Richard Zang updated AMBARI-19701:
--
Status: Patch Available  (was: Open)

> Provide minimal call context from UI when making stack advisor calls
> 
>
> Key: AMBARI-19701
> URL: https://issues.apache.org/jira/browse/AMBARI-19701
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Richard Zang
>Assignee: Richard Zang
> Fix For: 2.5.0
>
> Attachments: AMBARI-19701.patch
>
>
> We need to identify if call is made when
> * Cluster is being created (first call)
> * Add service
> * Just landing on a page and only need config attributes
> Possible change to the json data send in POST - 
> {code}
> {
> "recommend":"configurations",
>  "user-context" : { "operation" : "ClusterCreate" } <== add this
> "hosts"
> {code}
> *Cluster create (first call):*
> {code}"user-context": {"operation" : "ClusterCreate"}{code}
> *Add service (first call):*
> {code}"user-context": {"operation" : "AddService", "operation_details" : 
> "HDFS,YARN"}{code}
> *Landing on a config page:*
> {code}"user-context": {"operation" : "RecommendAttribute"}{code}
> *Config edit on a config page: (lower priority)*
> {code}"user-context": {"operation" : "EditConfig"}{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19701) Provide minimal call context from UI when making stack advisor calls

2017-01-24 Thread Richard Zang (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Richard Zang updated AMBARI-19701:
--
Attachment: AMBARI-19701.patch

> Provide minimal call context from UI when making stack advisor calls
> 
>
> Key: AMBARI-19701
> URL: https://issues.apache.org/jira/browse/AMBARI-19701
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Richard Zang
>Assignee: Richard Zang
> Fix For: 2.5.0
>
> Attachments: AMBARI-19701.patch
>
>
> We need to identify if call is made when
> * Cluster is being created (first call)
> * Add service
> * Just landing on a page and only need config attributes
> Possible change to the json data send in POST - 
> {code}
> {
> "recommend":"configurations",
>  "user-context" : { "operation" : "ClusterCreate" } <== add this
> "hosts"
> {code}
> *Cluster create (first call):*
> {code}"user-context": {"operation" : "ClusterCreate"}{code}
> *Add service (first call):*
> {code}"user-context": {"operation" : "AddService", "operation_details" : 
> "HDFS,YARN"}{code}
> *Landing on a config page:*
> {code}"user-context": {"operation" : "RecommendAttribute"}{code}
> *Config edit on a config page: (lower priority)*
> {code}"user-context": {"operation" : "EditConfig"}{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-17346) Dependent components should be shutdown before stopping hdfs

2017-01-24 Thread Ted Yu (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Yu updated AMBARI-17346:

Description: 
Sometimes admin shuts down hdfs first, then hbase. 

By the time hbase is shutdown, no data can be persisted (including metadata). 
This results in large number of inconsistencies when hbase cluster is brought 
back up.


Before hdfs is shutdown, the components dependent on hdfs should be shutdown 
first.

  was:
Sometimes admin shuts down hdfs first, then hbase. 

By the time hbase is shutdown, no data can be persisted (including metadata). 
This results in large number of inconsistencies when hbase cluster is brought 
back up.

Before hdfs is shutdown, the components dependent on hdfs should be shutdown 
first.


> Dependent components should be shutdown before stopping hdfs
> 
>
> Key: AMBARI-17346
> URL: https://issues.apache.org/jira/browse/AMBARI-17346
> Project: Ambari
>  Issue Type: Bug
>Reporter: Ted Yu
>
> Sometimes admin shuts down hdfs first, then hbase. 
> By the time hbase is shutdown, no data can be persisted (including metadata). 
> This results in large number of inconsistencies when hbase cluster is brought 
> back up.
> Before hdfs is shutdown, the components dependent on hdfs should be shutdown 
> first.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (AMBARI-19701) Provide minimal call context from UI when making stack advisor calls

2017-01-24 Thread Richard Zang (JIRA)
Richard Zang created AMBARI-19701:
-

 Summary: Provide minimal call context from UI when making stack 
advisor calls
 Key: AMBARI-19701
 URL: https://issues.apache.org/jira/browse/AMBARI-19701
 Project: Ambari
  Issue Type: Bug
  Components: ambari-web
Affects Versions: 2.5.0
Reporter: Richard Zang
Assignee: Richard Zang
 Fix For: 2.5.0


We need to identify if call is made when
* Cluster is being created (first call)
* Add service
* Just landing on a page and only need config attributes

Possible change to the json data send in POST - 
{code}
{
"recommend":"configurations",
 "user-context" : { "operation" : "ClusterCreate" } <== add this
"hosts"
{code}

*Cluster create (first call):*
{code}"user-context": {"operation" : "ClusterCreate"}{code}
*Add service (first call):*
{code}"user-context": {"operation" : "AddService", "operation_details" : 
"HDFS,YARN"}{code}
*Landing on a config page:*
{code}"user-context": {"operation" : "RecommendAttribute"}{code}
*Config edit on a config page: (lower priority)*
{code}"user-context": {"operation" : "EditConfig"}{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19098) HDP 3.0 TP - create Service Advisor for YARN/MR

2017-01-24 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837083#comment-15837083
 ] 

Hadoop QA commented on AMBARI-19098:


{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12849208/AMBARI-19098.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
ambari-server.

Test results: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10236//testReport/
Console output: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10236//console

This message is automatically generated.

> HDP 3.0 TP - create Service Advisor for YARN/MR
> ---
>
> Key: AMBARI-19098
> URL: https://issues.apache.org/jira/browse/AMBARI-19098
> Project: Ambari
>  Issue Type: Story
>  Components: stacks
>Affects Versions: 3.0.0
>Reporter: Alejandro Fernandez
>Assignee: Alejandro Fernandez
> Fix For: 3.0.0
>
> Attachments: AMBARI-19098.patch
>
>
> Create a Service Advisor script for YARN/MR in HDP 3.0 Tech Preview.
> The Service Advisor must encapsulate all of the logic inherited/overwritten 
> from HDP 2.0.6 through HDP 2.6



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19098) HDP 3.0 TP - create Service Advisor for YARN/MR

2017-01-24 Thread Alejandro Fernandez (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alejandro Fernandez updated AMBARI-19098:
-
Status: Patch Available  (was: Open)

> HDP 3.0 TP - create Service Advisor for YARN/MR
> ---
>
> Key: AMBARI-19098
> URL: https://issues.apache.org/jira/browse/AMBARI-19098
> Project: Ambari
>  Issue Type: Story
>  Components: stacks
>Affects Versions: 3.0.0
>Reporter: Alejandro Fernandez
>Assignee: Alejandro Fernandez
> Fix For: 3.0.0
>
> Attachments: AMBARI-19098.patch
>
>
> Create a Service Advisor script for YARN/MR in HDP 3.0 Tech Preview.
> The Service Advisor must encapsulate all of the logic inherited/overwritten 
> from HDP 2.0.6 through HDP 2.6



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19098) HDP 3.0 TP - create Service Advisor for YARN/MR

2017-01-24 Thread Alejandro Fernandez (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alejandro Fernandez updated AMBARI-19098:
-
Attachment: AMBARI-19098.patch

> HDP 3.0 TP - create Service Advisor for YARN/MR
> ---
>
> Key: AMBARI-19098
> URL: https://issues.apache.org/jira/browse/AMBARI-19098
> Project: Ambari
>  Issue Type: Story
>  Components: stacks
>Affects Versions: 3.0.0
>Reporter: Alejandro Fernandez
>Assignee: Alejandro Fernandez
> Fix For: 3.0.0
>
> Attachments: AMBARI-19098.patch
>
>
> Create a Service Advisor script for YARN/MR in HDP 3.0 Tech Preview.
> The Service Advisor must encapsulate all of the logic inherited/overwritten 
> from HDP 2.0.6 through HDP 2.6



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19098) HDP 3.0 TP - create Service Advisor for YARN/MR

2017-01-24 Thread Alejandro Fernandez (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alejandro Fernandez updated AMBARI-19098:
-
Status: Open  (was: Patch Available)

> HDP 3.0 TP - create Service Advisor for YARN/MR
> ---
>
> Key: AMBARI-19098
> URL: https://issues.apache.org/jira/browse/AMBARI-19098
> Project: Ambari
>  Issue Type: Story
>  Components: stacks
>Affects Versions: 3.0.0
>Reporter: Alejandro Fernandez
>Assignee: Alejandro Fernandez
> Fix For: 3.0.0
>
> Attachments: AMBARI-19098.patch
>
>
> Create a Service Advisor script for YARN/MR in HDP 3.0 Tech Preview.
> The Service Advisor must encapsulate all of the logic inherited/overwritten 
> from HDP 2.0.6 through HDP 2.6



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19098) HDP 3.0 TP - create Service Advisor for YARN/MR

2017-01-24 Thread Alejandro Fernandez (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Alejandro Fernandez updated AMBARI-19098:
-
Attachment: (was: AMBARI-19098.patch)

> HDP 3.0 TP - create Service Advisor for YARN/MR
> ---
>
> Key: AMBARI-19098
> URL: https://issues.apache.org/jira/browse/AMBARI-19098
> Project: Ambari
>  Issue Type: Story
>  Components: stacks
>Affects Versions: 3.0.0
>Reporter: Alejandro Fernandez
>Assignee: Alejandro Fernandez
> Fix For: 3.0.0
>
>
> Create a Service Advisor script for YARN/MR in HDP 3.0 Tech Preview.
> The Service Advisor must encapsulate all of the logic inherited/overwritten 
> from HDP 2.0.6 through HDP 2.6



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19685) Stack advisor needs to enforce component dependency for slaves and masters

2017-01-24 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837046#comment-15837046
 ] 

Hadoop QA commented on AMBARI-19685:


{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12849177/AMBARI-19685.3.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 9 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:red}-1 core tests{color}.  The test build failed in ambari-server 

Test results: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10235//testReport/
Console output: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10235//console

This message is automatically generated.

> Stack advisor needs to enforce component dependency for slaves and masters
> --
>
> Key: AMBARI-19685
> URL: https://issues.apache.org/jira/browse/AMBARI-19685
> Project: Ambari
>  Issue Type: Task
>  Components: ambari-sever
>Affects Versions: 2.5.0
>Reporter: Jaimin Jetly
>Assignee: Jaimin Jetly
> Fix For: 3.0.0
>
> Attachments: AMBARI-19685.2.patch, AMBARI-19685.3.patch, 
> AMBARI-19685.patch
>
>
> * Install Ambari cluster with latest trunk bits
> * Modify 
> /var/lib/ambari-server/resources/common-services/ZEPPELIN/0.6.0.2.5/metainfo.xml
>  to add the following:
> {noformat}
> Add to  node of ZEPPELIN_MASTER:
> 
>   SPARK/LIVY_SERVER
>   host
> 
> Add to  node:
>   
> SPARK
>   
> {noformat}
> * Install HDP 2.5.3 cluster with Spark
> * Once the cluster is installed, use Add Service Wizard to add Zeppelin
> * Assign Slaves and Clients step should appear (without the metainfo.xml 
> change, it will be skipped)
> * The user should not be able to proceed beyond this page unless at least one 
> Livy Server is selected <- this validation should be handled by the stack 
> advisor



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19699) Axis units and aggregators are wrong in some graphs of ambari grafana dashboards

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837028#comment-15837028
 ] 

Hudson commented on AMBARI-19699:
-

SUCCESS: Integrated in Jenkins build Ambari-trunk-Commit #6535 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/6535/])
AMBARI-19699. Axis units and aggregators are wrong in some graphs of (yusaku: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=bb8b44cff641c49397d1eb72481398036e90f459])
* (edit) 
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/files/grafana-dashboards/default/grafana-ambari-server-database.json
* (edit) 
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/files/grafana-dashboards/default/grafana-ambari-server.json


> Axis units and aggregators are wrong in some graphs of ambari grafana 
> dashboards
> 
>
> Key: AMBARI-19699
> URL: https://issues.apache.org/jira/browse/AMBARI-19699
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Vivek Ratnavel Subramanian
>Assignee: Vivek Ratnavel Subramanian
>Priority: Minor
> Fix For: 2.5.0
>
> Attachments: AMBARI-19699.v0.branch-2.5.patch
>
>
> Need to fix the following:
> ReadAllQuery.HostRoleCommandEntity is missing a Y axis.
> Total Cache Misses Y axis is wrong should not be time.
> Remove Max aggregator from all metrics (JVM dashboard)
> Cache Hits and Misses rate graphs aren't in the same units



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19699) Axis units and aggregators are wrong in some graphs of ambari grafana dashboards

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837013#comment-15837013
 ] 

Hudson commented on AMBARI-19699:
-

FAILURE: Integrated in Jenkins build Ambari-branch-2.5 #792 (See 
[https://builds.apache.org/job/Ambari-branch-2.5/792/])
AMBARI-19699. Axis units and aggregators are wrong in some graphs of (yusaku: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=4db2d97280813d5c6f1c1025cb085d3ad00425ed])
* (edit) 
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/files/grafana-dashboards/default/grafana-ambari-server.json
* (edit) 
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/files/grafana-dashboards/default/grafana-ambari-server-database.json


> Axis units and aggregators are wrong in some graphs of ambari grafana 
> dashboards
> 
>
> Key: AMBARI-19699
> URL: https://issues.apache.org/jira/browse/AMBARI-19699
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Vivek Ratnavel Subramanian
>Assignee: Vivek Ratnavel Subramanian
>Priority: Minor
> Fix For: 2.5.0
>
> Attachments: AMBARI-19699.v0.branch-2.5.patch
>
>
> Need to fix the following:
> ReadAllQuery.HostRoleCommandEntity is missing a Y axis.
> Total Cache Misses Y axis is wrong should not be time.
> Remove Max aggregator from all metrics (JVM dashboard)
> Cache Hits and Misses rate graphs aren't in the same units



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19700) When hiveserver2 LDAP authentication is enabled hive.server2.authentication.ldap.url property gets exported with hardcoded hostname

2017-01-24 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836996#comment-15836996
 ] 

Hadoop QA commented on AMBARI-19700:


{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12849182/AMBARI-19700.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 1 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
ambari-server.

Test results: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10234//testReport/
Console output: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10234//console

This message is automatically generated.

> When hiveserver2 LDAP authentication is enabled 
> hive.server2.authentication.ldap.url property gets exported with hardcoded 
> hostname
> ---
>
> Key: AMBARI-19700
> URL: https://issues.apache.org/jira/browse/AMBARI-19700
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server, blueprints
>Reporter: Amruta Borkar
>Assignee: Amruta Borkar
>Priority: Minor
> Fix For: trunk, 2.5.0
>
> Attachments: AMBARI-19700.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19699) Axis units and aggregators are wrong in some graphs of ambari grafana dashboards

2017-01-24 Thread Yusaku Sako (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yusaku Sako updated AMBARI-19699:
-
Resolution: Fixed
Status: Resolved  (was: Patch Available)

> Axis units and aggregators are wrong in some graphs of ambari grafana 
> dashboards
> 
>
> Key: AMBARI-19699
> URL: https://issues.apache.org/jira/browse/AMBARI-19699
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Vivek Ratnavel Subramanian
>Assignee: Vivek Ratnavel Subramanian
>Priority: Minor
> Fix For: 2.5.0
>
> Attachments: AMBARI-19699.v0.branch-2.5.patch
>
>
> Need to fix the following:
> ReadAllQuery.HostRoleCommandEntity is missing a Y axis.
> Total Cache Misses Y axis is wrong should not be time.
> Remove Max aggregator from all metrics (JVM dashboard)
> Cache Hits and Misses rate graphs aren't in the same units



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19699) Axis units and aggregators are wrong in some graphs of ambari grafana dashboards

2017-01-24 Thread Yusaku Sako (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836972#comment-15836972
 ] 

Yusaku Sako commented on AMBARI-19699:
--

This has been +1'd on ReviewBoard.
Committed to trunk and branch-2.5.

> Axis units and aggregators are wrong in some graphs of ambari grafana 
> dashboards
> 
>
> Key: AMBARI-19699
> URL: https://issues.apache.org/jira/browse/AMBARI-19699
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Vivek Ratnavel Subramanian
>Assignee: Vivek Ratnavel Subramanian
>Priority: Minor
> Fix For: 2.5.0
>
> Attachments: AMBARI-19699.v0.branch-2.5.patch
>
>
> Need to fix the following:
> ReadAllQuery.HostRoleCommandEntity is missing a Y axis.
> Total Cache Misses Y axis is wrong should not be time.
> Remove Max aggregator from all metrics (JVM dashboard)
> Cache Hits and Misses rate graphs aren't in the same units



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19658) LogSearch Integration Cache Timeout should be configurable

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836955#comment-15836955
 ] 

Hudson commented on AMBARI-19658:
-

FAILURE: Integrated in Jenkins build Ambari-branch-2.5 #791 (See 
[https://builds.apache.org/job/Ambari-branch-2.5/791/])
AMBARI-19658. LogSearch Integration Cache Timeout should be (rnettleton: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=adc63c05aa69610a36fcc4aa67ac37aa3cfe522e])
* (edit) 
ambari-server/src/main/java/org/apache/ambari/server/controller/logging/LogSearchDataRetrievalService.java
* (edit) 
ambari-server/src/test/java/org/apache/ambari/server/controller/logging/LogSearchDataRetrievalServiceTest.java
* (edit) 
ambari-server/src/main/java/org/apache/ambari/server/configuration/Configuration.java


> LogSearch Integration Cache Timeout should be configurable
> --
>
> Key: AMBARI-19658
> URL: https://issues.apache.org/jira/browse/AMBARI-19658
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 2.4.0
>Reporter: Robert Nettleton
>Assignee: Robert Nettleton
>Priority: Critical
> Fix For: 2.5.0
>
> Attachments: AMBARI-19658.patch
>
>
> In Ambari 2.4.0, during the initial integration with LogSearch, a cache was 
> implemented to reduce the number of calls to the LogSearch service when the 
> PropertyProvider implementation for LogSearch integration is called in other 
> contexts (such as Rolling/Express Upgrades, REST API calls on the 
> HostComponent resource, etc).  
> That cache was implemented in the following class:
> {code}
> org.apache.ambari.server.controller.logging.LogSearchDataRetrievalService
> {code}
> In the initial implementation, the cache was hard-coded to expire within in 
> hour. 
> In 
> org.apache.ambari.server.controller.logging.LogSearchDataRetrievalService#doStart:
> {code}
> protected void doStart() {
> LOG.debug("Initializing caches");
> // initialize the log file name cache
> logFileNameCache = CacheBuilder.newBuilder().expireAfterWrite(1, 
> TimeUnit.HOURS).build();
> // initialize the log file tail URI cache
> logFileTailURICache = CacheBuilder.newBuilder().expireAfterWrite(1, 
> TimeUnit.HOURS).build();
> // initialize the Executor
> executor = Executors.newSingleThreadExecutor();
>   }
> {code}
> An hour is probably too short of an interval, since the cache data is 
> unlikely to change often.  This timeout should be a configurable option in 
> the Ambari LogSearch Integration code.
> 1. The default timeout should be much larger, as this information obtained 
> from the LogSearch service is generally static.  We should increase the 
> timeout to be at least 24 hours, or perhaps move to an unbounded timeout, 
> provided that the timeout would be configurable. 
> 2. The max timeout for the cache should be configurable in ambari.properties, 
> with a reasonable default if not set (as mentioned above). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19688) Ubuntu14 base url fields on "Select version" page are duplicates

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836954#comment-15836954
 ] 

Hudson commented on AMBARI-19688:
-

FAILURE: Integrated in Jenkins build Ambari-branch-2.5 #791 (See 
[https://builds.apache.org/job/Ambari-branch-2.5/791/])
AMBARI-19688 - Ubuntu14 base url fields on "Select version" page are (rzang: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=337a651fa0a1cfdab79d71b06d3c7976e16e6992])
* (edit) ambari-web/app/controllers/installer.js


> Ubuntu14 base url fields on "Select version" page are duplicates
> 
>
> Key: AMBARI-19688
> URL: https://issues.apache.org/jira/browse/AMBARI-19688
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Richard Zang
>Assignee: Richard Zang
> Fix For: 2.5.0
>
> Attachments: AMBARI-19688_diagnosis.patch
>
>
> Ubuntu14 base url fields on "Select version" page are duplicates



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19688) Ubuntu14 base url fields on "Select version" page are duplicates

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836949#comment-15836949
 ] 

Hudson commented on AMBARI-19688:
-

SUCCESS: Integrated in Jenkins build Ambari-trunk-Commit #6534 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/6534/])
AMBARI-19688 - Ubuntu14 base url fields on "Select version" page are (rzang: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=b3a070c0011a542504c9fd586b26bccfaf1568f1])
* (edit) ambari-web/app/controllers/installer.js


> Ubuntu14 base url fields on "Select version" page are duplicates
> 
>
> Key: AMBARI-19688
> URL: https://issues.apache.org/jira/browse/AMBARI-19688
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Richard Zang
>Assignee: Richard Zang
> Fix For: 2.5.0
>
> Attachments: AMBARI-19688_diagnosis.patch
>
>
> Ubuntu14 base url fields on "Select version" page are duplicates



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19700) When hiveserver2 LDAP authentication is enabled hive.server2.authentication.ldap.url property gets exported with hardcoded hostname

2017-01-24 Thread Amruta Borkar (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Amruta Borkar updated AMBARI-19700:
---
Status: Patch Available  (was: In Progress)

> When hiveserver2 LDAP authentication is enabled 
> hive.server2.authentication.ldap.url property gets exported with hardcoded 
> hostname
> ---
>
> Key: AMBARI-19700
> URL: https://issues.apache.org/jira/browse/AMBARI-19700
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server, blueprints
>Reporter: Amruta Borkar
>Assignee: Amruta Borkar
>Priority: Minor
> Fix For: trunk, 2.5.0
>
> Attachments: AMBARI-19700.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19688) Ubuntu14 base url fields on "Select version" page are duplicates

2017-01-24 Thread Richard Zang (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Richard Zang updated AMBARI-19688:
--
Status: Patch Available  (was: Open)

> Ubuntu14 base url fields on "Select version" page are duplicates
> 
>
> Key: AMBARI-19688
> URL: https://issues.apache.org/jira/browse/AMBARI-19688
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Richard Zang
>Assignee: Richard Zang
> Fix For: 2.5.0
>
> Attachments: AMBARI-19688_diagnosis.patch
>
>
> Ubuntu14 base url fields on "Select version" page are duplicates



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19660) Add log rotation settings - handle upgrade scenario - Storm, Hive

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836845#comment-15836845
 ] 

Hudson commented on AMBARI-19660:
-

FAILURE: Integrated in Jenkins build Ambari-trunk-Commit #6533 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/6533/])
AMBARI-19660. Add log rotation settings - handle upgrade scenario - (smohanty: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=78fefdd4c327390062d16a15594b32bb816f65cf])
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/config-upgrade.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.6.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.6.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.6.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.4.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/config-upgrade.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.5.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.6.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.5.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.5.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.5.xml


> Add log rotation settings - handle upgrade scenario - Storm, Hive
> -
>
> Key: AMBARI-19660
> URL: https://issues.apache.org/jira/browse/AMBARI-19660
> Project: Ambari
>  Issue Type: Bug
>Reporter: Madhuvanthi Radhakrishnan
>Assignee: Madhuvanthi Radhakrishnan
>
> Changes made to all upgrade packs 2.3->2.4,2.5,2.6 ; 2.4->2.5,2.6 ; 2.5->2.6



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19658) LogSearch Integration Cache Timeout should be configurable

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836844#comment-15836844
 ] 

Hudson commented on AMBARI-19658:
-

FAILURE: Integrated in Jenkins build Ambari-trunk-Commit #6533 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/6533/])
AMBARI-19658. LogSearch Integration Cache Timeout should be (rnettleton: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=604620021908995d7b4581176ceecf6c44ffea26])
* (edit) 
ambari-server/src/main/java/org/apache/ambari/server/configuration/Configuration.java
* (edit) 
ambari-server/src/main/java/org/apache/ambari/server/controller/logging/LogSearchDataRetrievalService.java
* (edit) 
ambari-server/src/test/java/org/apache/ambari/server/controller/logging/LogSearchDataRetrievalServiceTest.java


> LogSearch Integration Cache Timeout should be configurable
> --
>
> Key: AMBARI-19658
> URL: https://issues.apache.org/jira/browse/AMBARI-19658
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 2.4.0
>Reporter: Robert Nettleton
>Assignee: Robert Nettleton
>Priority: Critical
> Fix For: 2.5.0
>
> Attachments: AMBARI-19658.patch
>
>
> In Ambari 2.4.0, during the initial integration with LogSearch, a cache was 
> implemented to reduce the number of calls to the LogSearch service when the 
> PropertyProvider implementation for LogSearch integration is called in other 
> contexts (such as Rolling/Express Upgrades, REST API calls on the 
> HostComponent resource, etc).  
> That cache was implemented in the following class:
> {code}
> org.apache.ambari.server.controller.logging.LogSearchDataRetrievalService
> {code}
> In the initial implementation, the cache was hard-coded to expire within in 
> hour. 
> In 
> org.apache.ambari.server.controller.logging.LogSearchDataRetrievalService#doStart:
> {code}
> protected void doStart() {
> LOG.debug("Initializing caches");
> // initialize the log file name cache
> logFileNameCache = CacheBuilder.newBuilder().expireAfterWrite(1, 
> TimeUnit.HOURS).build();
> // initialize the log file tail URI cache
> logFileTailURICache = CacheBuilder.newBuilder().expireAfterWrite(1, 
> TimeUnit.HOURS).build();
> // initialize the Executor
> executor = Executors.newSingleThreadExecutor();
>   }
> {code}
> An hour is probably too short of an interval, since the cache data is 
> unlikely to change often.  This timeout should be a configurable option in 
> the Ambari LogSearch Integration code.
> 1. The default timeout should be much larger, as this information obtained 
> from the LogSearch service is generally static.  We should increase the 
> timeout to be at least 24 hours, or perhaps move to an unbounded timeout, 
> provided that the timeout would be configurable. 
> 2. The max timeout for the cache should be configurable in ambari.properties, 
> with a reasonable default if not set (as mentioned above). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19688) Ubuntu14 base url fields on "Select version" page are duplicates

2017-01-24 Thread Richard Zang (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Richard Zang updated AMBARI-19688:
--
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Diagnosis patch committed to trunk and 2.5. 
b3a070c0011a542504c9fd586b26bccfaf1568f1

> Ubuntu14 base url fields on "Select version" page are duplicates
> 
>
> Key: AMBARI-19688
> URL: https://issues.apache.org/jira/browse/AMBARI-19688
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Richard Zang
>Assignee: Richard Zang
> Fix For: 2.5.0
>
> Attachments: AMBARI-19688_diagnosis.patch
>
>
> Ubuntu14 base url fields on "Select version" page are duplicates



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (AMBARI-19700) When hiveserver2 LDAP authentication is enabled hive.server2.authentication.ldap.url property gets exported with hardcoded hostname

2017-01-24 Thread Amruta Borkar (JIRA)
Amruta Borkar created AMBARI-19700:
--

 Summary: When hiveserver2 LDAP authentication is enabled 
hive.server2.authentication.ldap.url property gets exported with hardcoded 
hostname
 Key: AMBARI-19700
 URL: https://issues.apache.org/jira/browse/AMBARI-19700
 Project: Ambari
  Issue Type: Bug
  Components: ambari-server, blueprints
Reporter: Amruta Borkar
Assignee: Amruta Borkar
Priority: Minor






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19700) When hiveserver2 LDAP authentication is enabled hive.server2.authentication.ldap.url property gets exported with hardcoded hostname

2017-01-24 Thread Amruta Borkar (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Amruta Borkar updated AMBARI-19700:
---
Fix Version/s: 2.5.0
   trunk

> When hiveserver2 LDAP authentication is enabled 
> hive.server2.authentication.ldap.url property gets exported with hardcoded 
> hostname
> ---
>
> Key: AMBARI-19700
> URL: https://issues.apache.org/jira/browse/AMBARI-19700
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server, blueprints
>Reporter: Amruta Borkar
>Assignee: Amruta Borkar
>Priority: Minor
> Fix For: trunk, 2.5.0
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19660) Add log rotation settings - handle upgrade scenario - Storm, Hive

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836831#comment-15836831
 ] 

Hudson commented on AMBARI-19660:
-

FAILURE: Integrated in Jenkins build Ambari-branch-2.5 #790 (See 
[https://builds.apache.org/job/Ambari-branch-2.5/790/])
AMBARI-19660. Add log rotation settings - handle upgrade scenario - (smohanty: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=9f8401a4af4bdb123c030d7f783a5176136ec5db])
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.6.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.5.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/config-upgrade.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/nonrolling-upgrade-2.6.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.5.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.4.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/upgrade-2.6.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.5/upgrades/config-upgrade.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.6.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/config-upgrade.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/nonrolling-upgrade-2.4.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/upgrades/upgrade-2.5.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.5.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/upgrade-2.6.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.4/upgrades/nonrolling-upgrade-2.6.xml


> Add log rotation settings - handle upgrade scenario - Storm, Hive
> -
>
> Key: AMBARI-19660
> URL: https://issues.apache.org/jira/browse/AMBARI-19660
> Project: Ambari
>  Issue Type: Bug
>Reporter: Madhuvanthi Radhakrishnan
>Assignee: Madhuvanthi Radhakrishnan
>
> Changes made to all upgrade packs 2.3->2.4,2.5,2.6 ; 2.4->2.5,2.6 ; 2.5->2.6



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19700) When hiveserver2 LDAP authentication is enabled hive.server2.authentication.ldap.url property gets exported with hardcoded hostname

2017-01-24 Thread Amruta Borkar (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Amruta Borkar updated AMBARI-19700:
---
Attachment: AMBARI-19700.patch

> When hiveserver2 LDAP authentication is enabled 
> hive.server2.authentication.ldap.url property gets exported with hardcoded 
> hostname
> ---
>
> Key: AMBARI-19700
> URL: https://issues.apache.org/jira/browse/AMBARI-19700
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server, blueprints
>Reporter: Amruta Borkar
>Assignee: Amruta Borkar
>Priority: Minor
> Fix For: trunk, 2.5.0
>
> Attachments: AMBARI-19700.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19658) LogSearch Integration Cache Timeout should be configurable

2017-01-24 Thread Robert Nettleton (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Robert Nettleton updated AMBARI-19658:
--
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Patch merged to trunk and branch-2.5


> LogSearch Integration Cache Timeout should be configurable
> --
>
> Key: AMBARI-19658
> URL: https://issues.apache.org/jira/browse/AMBARI-19658
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 2.4.0
>Reporter: Robert Nettleton
>Assignee: Robert Nettleton
>Priority: Critical
> Fix For: 2.5.0
>
> Attachments: AMBARI-19658.patch
>
>
> In Ambari 2.4.0, during the initial integration with LogSearch, a cache was 
> implemented to reduce the number of calls to the LogSearch service when the 
> PropertyProvider implementation for LogSearch integration is called in other 
> contexts (such as Rolling/Express Upgrades, REST API calls on the 
> HostComponent resource, etc).  
> That cache was implemented in the following class:
> {code}
> org.apache.ambari.server.controller.logging.LogSearchDataRetrievalService
> {code}
> In the initial implementation, the cache was hard-coded to expire within in 
> hour. 
> In 
> org.apache.ambari.server.controller.logging.LogSearchDataRetrievalService#doStart:
> {code}
> protected void doStart() {
> LOG.debug("Initializing caches");
> // initialize the log file name cache
> logFileNameCache = CacheBuilder.newBuilder().expireAfterWrite(1, 
> TimeUnit.HOURS).build();
> // initialize the log file tail URI cache
> logFileTailURICache = CacheBuilder.newBuilder().expireAfterWrite(1, 
> TimeUnit.HOURS).build();
> // initialize the Executor
> executor = Executors.newSingleThreadExecutor();
>   }
> {code}
> An hour is probably too short of an interval, since the cache data is 
> unlikely to change often.  This timeout should be a configurable option in 
> the Ambari LogSearch Integration code.
> 1. The default timeout should be much larger, as this information obtained 
> from the LogSearch service is generally static.  We should increase the 
> timeout to be at least 24 hours, or perhaps move to an unbounded timeout, 
> provided that the timeout would be configurable. 
> 2. The max timeout for the cache should be configurable in ambari.properties, 
> with a reasonable default if not set (as mentioned above). 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19693) Permission issues with conf.server/hive-site.xml across several hive components

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836788#comment-15836788
 ] 

Hudson commented on AMBARI-19693:
-

SUCCESS: Integrated in Jenkins build Ambari-trunk-Commit #6532 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/6532/])
AMBARI-19693. Permission issues with conf.server/hive-site.xml across 
(smohanty: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=2a2b4e94feacfff56097293810867ce627b1778a])
* (edit) ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hcat_client.py
* (edit) 
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hcat.py


> Permission issues with conf.server/hive-site.xml across several hive 
> components
> ---
>
> Key: AMBARI-19693
> URL: https://issues.apache.org/jira/browse/AMBARI-19693
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: trunk, 2.5.0
>Reporter: Dmytro Grinenko
>Assignee: Dmytro Grinenko
>Priority: Blocker
> Fix For: trunk, 2.5.0
>
> Attachments: AMBARI-19693-branch-2.5.patch, AMBARI-19693.patch
>
>
> {code}
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/service_check.py",
>  line 193, in 
> HiveServiceCheck().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 287, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/service_check.py",
>  line 95, in service_check
> hcat_service_check()
>   File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", 
> line 89, in thunk
> return fn(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_service_check.py",
>  line 65, in hcat_service_check
> logoutput=True)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", 
> line 155, in __init__
> self.env.run()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", 
> line 160, in run
> self.run_action(resource, action)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", 
> line 124, in run_action
> provider_action()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
>  line 262, in action_run
> tries=self.resource.tries, try_sleep=self.resource.try_sleep)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 72, in inner
> result = function(command, **kwargs)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 102, in checked_call
> tries=tries, try_sleep=try_sleep, 
> timeout_kill_strategy=timeout_kill_strategy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 150, in _call_wrapper
> result = _call(command, **kwargs_copy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 303, in _call
> raise ExecutionFailed(err_msg, code, out, err)
> resource_management.core.exceptions.ExecutionFailed: Execution of 
> '/usr/bin/kinit -kt /etc/security/keytabs/smokeuser.headless.keytab 
> ambari...@example.com; env JAVA_HOME=/usr/jdk64/jdk1.7.0_67 
> /var/lib/ambari-agent/tmp/hcatSmoke.sh hcatsmokeid16ac7075_date383016 prepare 
> true' returned 88.  Hortonworks #
> This is MOTD message, added for testing in qe infra
> WARNING: Use "yarn jar" to launch YARN applications.
> FAILED: SemanticException [Error 10072]: Database does not exist: default
> WARNING: Use "yarn jar" to launch YARN applications.
> OK
> Time taken: 3.012 seconds
> WARNING: Use "yarn jar" to launch YARN applications.
> FAILED: SemanticException [Error 10072]: Database does not exist: default
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19682) Small fixes to log4j rotation properties - Yarn, ZooKeeper, AMS-Hbase, Logsearch/Logfeeder

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836789#comment-15836789
 ] 

Hudson commented on AMBARI-19682:
-

SUCCESS: Integrated in Jenkins build Ambari-trunk-Commit #6532 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/6532/])
AMBARI-19682. Small fixes for common log rotation (Madhuvanthi (smohanty: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=1b630ebc6406ac2d81b375d4b503e028f6609c0e])
* (edit) 
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/configuration/yarn-log4j.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/services/YARN/configuration/yarn-log4j.xml
* (edit) 
ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/configuration/logfeeder-log4j.xml
* (edit) 
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-hbase-log4j.xml
* (edit) 
ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/configuration/logsearch-log4j.xml
* (edit) 
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5/configuration/zookeeper-log4j.xml


> Small fixes to log4j rotation properties - Yarn, ZooKeeper, AMS-Hbase, 
> Logsearch/Logfeeder
> --
>
> Key: AMBARI-19682
> URL: https://issues.apache.org/jira/browse/AMBARI-19682
> Project: Ambari
>  Issue Type: Bug
>Reporter: Madhuvanthi Radhakrishnan
>Assignee: Madhuvanthi Radhakrishnan
> Fix For: 2.5.0
>
>
> Naming convention changes for services listed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19685) Stack advisor needs to enforce component dependency for slaves and masters

2017-01-24 Thread Jaimin Jetly (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jaimin Jetly updated AMBARI-19685:
--
Attachment: AMBARI-19685.3.patch

> Stack advisor needs to enforce component dependency for slaves and masters
> --
>
> Key: AMBARI-19685
> URL: https://issues.apache.org/jira/browse/AMBARI-19685
> Project: Ambari
>  Issue Type: Task
>  Components: ambari-sever
>Affects Versions: 2.5.0
>Reporter: Jaimin Jetly
>Assignee: Jaimin Jetly
> Fix For: 3.0.0
>
> Attachments: AMBARI-19685.2.patch, AMBARI-19685.3.patch, 
> AMBARI-19685.patch
>
>
> * Install Ambari cluster with latest trunk bits
> * Modify 
> /var/lib/ambari-server/resources/common-services/ZEPPELIN/0.6.0.2.5/metainfo.xml
>  to add the following:
> {noformat}
> Add to  node of ZEPPELIN_MASTER:
> 
>   SPARK/LIVY_SERVER
>   host
> 
> Add to  node:
>   
> SPARK
>   
> {noformat}
> * Install HDP 2.5.3 cluster with Spark
> * Once the cluster is installed, use Add Service Wizard to add Zeppelin
> * Assign Slaves and Clients step should appear (without the metainfo.xml 
> change, it will be skipped)
> * The user should not be able to proceed beyond this page unless at least one 
> Livy Server is selected <- this validation should be handled by the stack 
> advisor



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19682) Small fixes to log4j rotation properties - Yarn, ZooKeeper, AMS-Hbase, Logsearch/Logfeeder

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836782#comment-15836782
 ] 

Hudson commented on AMBARI-19682:
-

SUCCESS: Integrated in Jenkins build Ambari-branch-2.5 #789 (See 
[https://builds.apache.org/job/Ambari-branch-2.5/789/])
AMBARI-19682. Small fixes for common log rotation (Madhuvanthi (smohanty: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=c34a836b77662163a3b6f3b6fe533b6cf01d45e5])
* (edit) 
ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/configuration/logfeeder-log4j.xml
* (edit) 
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/configuration/ams-hbase-log4j.xml
* (edit) 
ambari-server/src/main/resources/common-services/ZOOKEEPER/3.4.5/configuration/zookeeper-log4j.xml
* (edit) 
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/configuration/yarn-log4j.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/services/YARN/configuration/yarn-log4j.xml
* (edit) 
ambari-server/src/main/resources/common-services/LOGSEARCH/0.5.0/configuration/logsearch-log4j.xml


> Small fixes to log4j rotation properties - Yarn, ZooKeeper, AMS-Hbase, 
> Logsearch/Logfeeder
> --
>
> Key: AMBARI-19682
> URL: https://issues.apache.org/jira/browse/AMBARI-19682
> Project: Ambari
>  Issue Type: Bug
>Reporter: Madhuvanthi Radhakrishnan
>Assignee: Madhuvanthi Radhakrishnan
> Fix For: 2.5.0
>
>
> Naming convention changes for services listed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19693) Permission issues with conf.server/hive-site.xml across several hive components

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836781#comment-15836781
 ] 

Hudson commented on AMBARI-19693:
-

SUCCESS: Integrated in Jenkins build Ambari-branch-2.5 #789 (See 
[https://builds.apache.org/job/Ambari-branch-2.5/789/])
AMBARI-19693. Permission issues with conf.server/hive-site.xml across 
(smohanty: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=59441de0ba9cc7bc649bc2127e1e78d86a84fd5a])
* (edit) 
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/scripts/hcat.py
* (edit) ambari-server/src/test/python/stacks/2.0.6/HIVE/test_hcat_client.py


> Permission issues with conf.server/hive-site.xml across several hive 
> components
> ---
>
> Key: AMBARI-19693
> URL: https://issues.apache.org/jira/browse/AMBARI-19693
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: trunk, 2.5.0
>Reporter: Dmytro Grinenko
>Assignee: Dmytro Grinenko
>Priority: Blocker
> Fix For: trunk, 2.5.0
>
> Attachments: AMBARI-19693-branch-2.5.patch, AMBARI-19693.patch
>
>
> {code}
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/service_check.py",
>  line 193, in 
> HiveServiceCheck().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 287, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/service_check.py",
>  line 95, in service_check
> hcat_service_check()
>   File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", 
> line 89, in thunk
> return fn(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_service_check.py",
>  line 65, in hcat_service_check
> logoutput=True)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", 
> line 155, in __init__
> self.env.run()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", 
> line 160, in run
> self.run_action(resource, action)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", 
> line 124, in run_action
> provider_action()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
>  line 262, in action_run
> tries=self.resource.tries, try_sleep=self.resource.try_sleep)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 72, in inner
> result = function(command, **kwargs)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 102, in checked_call
> tries=tries, try_sleep=try_sleep, 
> timeout_kill_strategy=timeout_kill_strategy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 150, in _call_wrapper
> result = _call(command, **kwargs_copy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 303, in _call
> raise ExecutionFailed(err_msg, code, out, err)
> resource_management.core.exceptions.ExecutionFailed: Execution of 
> '/usr/bin/kinit -kt /etc/security/keytabs/smokeuser.headless.keytab 
> ambari...@example.com; env JAVA_HOME=/usr/jdk64/jdk1.7.0_67 
> /var/lib/ambari-agent/tmp/hcatSmoke.sh hcatsmokeid16ac7075_date383016 prepare 
> true' returned 88.  Hortonworks #
> This is MOTD message, added for testing in qe infra
> WARNING: Use "yarn jar" to launch YARN applications.
> FAILED: SemanticException [Error 10072]: Database does not exist: default
> WARNING: Use "yarn jar" to launch YARN applications.
> OK
> Time taken: 3.012 seconds
> WARNING: Use "yarn jar" to launch YARN applications.
> FAILED: SemanticException [Error 10072]: Database does not exist: default
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19688) Ubuntu14 base url fields on "Select version" page are duplicates

2017-01-24 Thread Xi Wang (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836757#comment-15836757
 ] 

Xi Wang commented on AMBARI-19688:
--

+1 for patch.

> Ubuntu14 base url fields on "Select version" page are duplicates
> 
>
> Key: AMBARI-19688
> URL: https://issues.apache.org/jira/browse/AMBARI-19688
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Richard Zang
>Assignee: Richard Zang
> Fix For: 2.5.0
>
> Attachments: AMBARI-19688_diagnosis.patch
>
>
> Ubuntu14 base url fields on "Select version" page are duplicates



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19699) Axis units and aggregators are wrong in some graphs of ambari grafana dashboards

2017-01-24 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836735#comment-15836735
 ] 

Hadoop QA commented on AMBARI-19699:


{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  
http://issues.apache.org/jira/secure/attachment/12849165/AMBARI-19699.v0.branch-2.5.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
ambari-server.

Test results: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10233//testReport/
Console output: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10233//console

This message is automatically generated.

> Axis units and aggregators are wrong in some graphs of ambari grafana 
> dashboards
> 
>
> Key: AMBARI-19699
> URL: https://issues.apache.org/jira/browse/AMBARI-19699
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Vivek Ratnavel Subramanian
>Assignee: Vivek Ratnavel Subramanian
>Priority: Minor
> Fix For: 2.5.0
>
> Attachments: AMBARI-19699.v0.branch-2.5.patch
>
>
> Need to fix the following:
> ReadAllQuery.HostRoleCommandEntity is missing a Y axis.
> Total Cache Misses Y axis is wrong should not be time.
> Remove Max aggregator from all metrics (JVM dashboard)
> Cache Hits and Misses rate graphs aren't in the same units



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (AMBARI-19660) Add log rotation settings - handle upgrade scenario - Storm, Hive

2017-01-24 Thread Sumit Mohanty (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sumit Mohanty resolved AMBARI-19660.

Resolution: Fixed

Committed to trunk and branch-2.5

> Add log rotation settings - handle upgrade scenario - Storm, Hive
> -
>
> Key: AMBARI-19660
> URL: https://issues.apache.org/jira/browse/AMBARI-19660
> Project: Ambari
>  Issue Type: Bug
>Reporter: Madhuvanthi Radhakrishnan
>Assignee: Madhuvanthi Radhakrishnan
>
> Changes made to all upgrade packs 2.3->2.4,2.5,2.6 ; 2.4->2.5,2.6 ; 2.5->2.6



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (AMBARI-19682) Small fixes to log4j rotation properties - Yarn, ZooKeeper, AMS-Hbase, Logsearch/Logfeeder

2017-01-24 Thread Sumit Mohanty (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sumit Mohanty resolved AMBARI-19682.

Resolution: Fixed

Committed to trunk and branch-2.5

> Small fixes to log4j rotation properties - Yarn, ZooKeeper, AMS-Hbase, 
> Logsearch/Logfeeder
> --
>
> Key: AMBARI-19682
> URL: https://issues.apache.org/jira/browse/AMBARI-19682
> Project: Ambari
>  Issue Type: Bug
>Reporter: Madhuvanthi Radhakrishnan
>Assignee: Madhuvanthi Radhakrishnan
> Fix For: 2.5.0
>
>
> Naming convention changes for services listed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19693) Permission issues with conf.server/hive-site.xml across several hive components

2017-01-24 Thread Sumit Mohanty (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sumit Mohanty updated AMBARI-19693:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Committed to trunk and branch-2.5

> Permission issues with conf.server/hive-site.xml across several hive 
> components
> ---
>
> Key: AMBARI-19693
> URL: https://issues.apache.org/jira/browse/AMBARI-19693
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: trunk, 2.5.0
>Reporter: Dmytro Grinenko
>Assignee: Dmytro Grinenko
>Priority: Blocker
> Fix For: trunk, 2.5.0
>
> Attachments: AMBARI-19693-branch-2.5.patch, AMBARI-19693.patch
>
>
> {code}
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/service_check.py",
>  line 193, in 
> HiveServiceCheck().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 287, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/service_check.py",
>  line 95, in service_check
> hcat_service_check()
>   File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", 
> line 89, in thunk
> return fn(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_service_check.py",
>  line 65, in hcat_service_check
> logoutput=True)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", 
> line 155, in __init__
> self.env.run()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", 
> line 160, in run
> self.run_action(resource, action)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", 
> line 124, in run_action
> provider_action()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
>  line 262, in action_run
> tries=self.resource.tries, try_sleep=self.resource.try_sleep)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 72, in inner
> result = function(command, **kwargs)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 102, in checked_call
> tries=tries, try_sleep=try_sleep, 
> timeout_kill_strategy=timeout_kill_strategy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 150, in _call_wrapper
> result = _call(command, **kwargs_copy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 303, in _call
> raise ExecutionFailed(err_msg, code, out, err)
> resource_management.core.exceptions.ExecutionFailed: Execution of 
> '/usr/bin/kinit -kt /etc/security/keytabs/smokeuser.headless.keytab 
> ambari...@example.com; env JAVA_HOME=/usr/jdk64/jdk1.7.0_67 
> /var/lib/ambari-agent/tmp/hcatSmoke.sh hcatsmokeid16ac7075_date383016 prepare 
> true' returned 88.  Hortonworks #
> This is MOTD message, added for testing in qe infra
> WARNING: Use "yarn jar" to launch YARN applications.
> FAILED: SemanticException [Error 10072]: Database does not exist: default
> WARNING: Use "yarn jar" to launch YARN applications.
> OK
> Time taken: 3.012 seconds
> WARNING: Use "yarn jar" to launch YARN applications.
> FAILED: SemanticException [Error 10072]: Database does not exist: default
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19681) Credential Store should add hadoop credential provider path property to all affected configuration types

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836674#comment-15836674
 ] 

Hudson commented on AMBARI-19681:
-

SUCCESS: Integrated in Jenkins build Ambari-trunk-Commit #6531 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/6531/])
AMBARI-19681: Credential store should add hadoop credential provider 
(nsomasundaram: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=f4f7571d8f9a7709f030cd2587052492e40e8527])
* (edit) 
ambari-common/src/main/python/resource_management/libraries/functions/security_commons.py
* (edit) ambari-agent/src/main/python/ambari_agent/CustomServiceOrchestrator.py


> Credential Store should add hadoop credential provider path property to all 
> affected configuration types
> 
>
> Key: AMBARI-19681
> URL: https://issues.apache.org/jira/browse/AMBARI-19681
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-agent
>Affects Versions: 2.5.0
>Reporter: Nahappan Somasundaram
>Assignee: Nahappan Somasundaram
> Fix For: 2.5.0
>
> Attachments: rb55853.patch
>
>
> CustomServiceOrchestrator.py function generateJceks adds the property 
> 'hadoop.security.credential.provider.path' only to the last configuration 
> type that requires it. The function iterates over the configtype_credentials 
> dictionary, and at each iteration it updates the variable named config (line 
> 272):
> {code}
> config = commandJson['configurations'][config_type]
> {code}
> After the iteration is over, and the provider_paths variable is set the 
> function adds the provider paths to the dictionary with the key 
> 'hadoop.security.credential.provider.path' (line 292)
> {code}
> config[self.CREDENTIAL_PROVIDER_PROPERTY_NAME] = ','.join(provider_paths)
> {code}
> The problem is that at this point the variable config contains the latest 
> config type that needs this property to be set up, while all of them should 
> have it! So if both config_type_1, and config_type_2 have passwords 
> properties present in configtype_credentials, only config_type_2 will have 
> the dictionary entry set for the key 
> 'hadoop.security.credential.provider.path', and it will contain a reference 
> to both of their jceks files!
> Another issue is that there is no reason to collect the provider paths to an 
> array, each config_type should have a reference only to it's own provider.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19693) Permission issues with conf.server/hive-site.xml across several hive components

2017-01-24 Thread Dmytro Grinenko (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dmytro Grinenko updated AMBARI-19693:
-
Attachment: AMBARI-19693-branch-2.5.patch

> Permission issues with conf.server/hive-site.xml across several hive 
> components
> ---
>
> Key: AMBARI-19693
> URL: https://issues.apache.org/jira/browse/AMBARI-19693
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: trunk, 2.5.0
>Reporter: Dmytro Grinenko
>Assignee: Dmytro Grinenko
>Priority: Blocker
> Fix For: trunk, 2.5.0
>
> Attachments: AMBARI-19693-branch-2.5.patch, AMBARI-19693.patch
>
>
> {code}
> Traceback (most recent call last):
>   File 
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/service_check.py",
>  line 193, in 
> HiveServiceCheck().execute()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py",
>  line 287, in execute
> method(env)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/service_check.py",
>  line 95, in service_check
> hcat_service_check()
>   File "/usr/lib/python2.6/site-packages/ambari_commons/os_family_impl.py", 
> line 89, in thunk
> return fn(*args, **kwargs)
>   File 
> "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_service_check.py",
>  line 65, in hcat_service_check
> logoutput=True)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", 
> line 155, in __init__
> self.env.run()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", 
> line 160, in run
> self.run_action(resource, action)
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", 
> line 124, in run_action
> provider_action()
>   File 
> "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py",
>  line 262, in action_run
> tries=self.resource.tries, try_sleep=self.resource.try_sleep)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 72, in inner
> result = function(command, **kwargs)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 102, in checked_call
> tries=tries, try_sleep=try_sleep, 
> timeout_kill_strategy=timeout_kill_strategy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 150, in _call_wrapper
> result = _call(command, **kwargs_copy)
>   File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", 
> line 303, in _call
> raise ExecutionFailed(err_msg, code, out, err)
> resource_management.core.exceptions.ExecutionFailed: Execution of 
> '/usr/bin/kinit -kt /etc/security/keytabs/smokeuser.headless.keytab 
> ambari...@example.com; env JAVA_HOME=/usr/jdk64/jdk1.7.0_67 
> /var/lib/ambari-agent/tmp/hcatSmoke.sh hcatsmokeid16ac7075_date383016 prepare 
> true' returned 88.  Hortonworks #
> This is MOTD message, added for testing in qe infra
> WARNING: Use "yarn jar" to launch YARN applications.
> FAILED: SemanticException [Error 10072]: Database does not exist: default
> WARNING: Use "yarn jar" to launch YARN applications.
> OK
> Time taken: 3.012 seconds
> WARNING: Use "yarn jar" to launch YARN applications.
> FAILED: SemanticException [Error 10072]: Database does not exist: default
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19685) Stack advisor needs to enforce component dependency for slaves and masters

2017-01-24 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836669#comment-15836669
 ] 

Hadoop QA commented on AMBARI-19685:


{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12849157/AMBARI-19685.2.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 7 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:red}-1 core tests{color}.  The test build failed in ambari-server 

Test results: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10232//testReport/
Console output: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10232//console

This message is automatically generated.

> Stack advisor needs to enforce component dependency for slaves and masters
> --
>
> Key: AMBARI-19685
> URL: https://issues.apache.org/jira/browse/AMBARI-19685
> Project: Ambari
>  Issue Type: Task
>  Components: ambari-sever
>Affects Versions: 2.5.0
>Reporter: Jaimin Jetly
>Assignee: Jaimin Jetly
> Fix For: 3.0.0
>
> Attachments: AMBARI-19685.2.patch, AMBARI-19685.patch
>
>
> * Install Ambari cluster with latest trunk bits
> * Modify 
> /var/lib/ambari-server/resources/common-services/ZEPPELIN/0.6.0.2.5/metainfo.xml
>  to add the following:
> {noformat}
> Add to  node of ZEPPELIN_MASTER:
> 
>   SPARK/LIVY_SERVER
>   host
> 
> Add to  node:
>   
> SPARK
>   
> {noformat}
> * Install HDP 2.5.3 cluster with Spark
> * Once the cluster is installed, use Add Service Wizard to add Zeppelin
> * Assign Slaves and Clients step should appear (without the metainfo.xml 
> change, it will be skipped)
> * The user should not be able to proceed beyond this page unless at least one 
> Livy Server is selected <- this validation should be handled by the stack 
> advisor



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19681) Credential Store should add hadoop credential provider path property to all affected configuration types

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836656#comment-15836656
 ] 

Hudson commented on AMBARI-19681:
-

SUCCESS: Integrated in Jenkins build Ambari-branch-2.5 #788 (See 
[https://builds.apache.org/job/Ambari-branch-2.5/788/])
AMBARI-19681: Credential store should add hadoop credential provider 
(nsomasundaram: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=77bd5ebebaf5808a4e9627cca0b0a77a12ad6aec])
* (edit) ambari-agent/src/main/python/ambari_agent/CustomServiceOrchestrator.py
* (edit) 
ambari-common/src/main/python/resource_management/libraries/functions/security_commons.py


> Credential Store should add hadoop credential provider path property to all 
> affected configuration types
> 
>
> Key: AMBARI-19681
> URL: https://issues.apache.org/jira/browse/AMBARI-19681
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-agent
>Affects Versions: 2.5.0
>Reporter: Nahappan Somasundaram
>Assignee: Nahappan Somasundaram
> Fix For: 2.5.0
>
> Attachments: rb55853.patch
>
>
> CustomServiceOrchestrator.py function generateJceks adds the property 
> 'hadoop.security.credential.provider.path' only to the last configuration 
> type that requires it. The function iterates over the configtype_credentials 
> dictionary, and at each iteration it updates the variable named config (line 
> 272):
> {code}
> config = commandJson['configurations'][config_type]
> {code}
> After the iteration is over, and the provider_paths variable is set the 
> function adds the provider paths to the dictionary with the key 
> 'hadoop.security.credential.provider.path' (line 292)
> {code}
> config[self.CREDENTIAL_PROVIDER_PROPERTY_NAME] = ','.join(provider_paths)
> {code}
> The problem is that at this point the variable config contains the latest 
> config type that needs this property to be set up, while all of them should 
> have it! So if both config_type_1, and config_type_2 have passwords 
> properties present in configtype_credentials, only config_type_2 will have 
> the dictionary entry set for the key 
> 'hadoop.security.credential.provider.path', and it will contain a reference 
> to both of their jceks files!
> Another issue is that there is no reason to collect the provider paths to an 
> array, each config_type should have a reference only to it's own provider.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19699) Axis units and aggregators are wrong in some graphs of ambari grafana dashboards

2017-01-24 Thread Vivek Ratnavel Subramanian (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vivek Ratnavel Subramanian updated AMBARI-19699:

Status: Patch Available  (was: Open)

> Axis units and aggregators are wrong in some graphs of ambari grafana 
> dashboards
> 
>
> Key: AMBARI-19699
> URL: https://issues.apache.org/jira/browse/AMBARI-19699
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Vivek Ratnavel Subramanian
>Assignee: Vivek Ratnavel Subramanian
>Priority: Minor
> Fix For: 2.5.0
>
> Attachments: AMBARI-19699.v0.branch-2.5.patch
>
>
> Need to fix the following:
> ReadAllQuery.HostRoleCommandEntity is missing a Y axis.
> Total Cache Misses Y axis is wrong should not be time.
> Remove Max aggregator from all metrics (JVM dashboard)
> Cache Hits and Misses rate graphs aren't in the same units



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19699) Axis units and aggregators are wrong in some graphs of ambari grafana dashboards

2017-01-24 Thread Vivek Ratnavel Subramanian (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vivek Ratnavel Subramanian updated AMBARI-19699:

Attachment: AMBARI-19699.v0.branch-2.5.patch

> Axis units and aggregators are wrong in some graphs of ambari grafana 
> dashboards
> 
>
> Key: AMBARI-19699
> URL: https://issues.apache.org/jira/browse/AMBARI-19699
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Vivek Ratnavel Subramanian
>Assignee: Vivek Ratnavel Subramanian
>Priority: Minor
> Fix For: 2.5.0
>
> Attachments: AMBARI-19699.v0.branch-2.5.patch
>
>
> Need to fix the following:
> ReadAllQuery.HostRoleCommandEntity is missing a Y axis.
> Total Cache Misses Y axis is wrong should not be time.
> Remove Max aggregator from all metrics (JVM dashboard)
> Cache Hits and Misses rate graphs aren't in the same units



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-13324) Ambari doesn't create Flume Kerberos principal + keytab

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-13324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836640#comment-15836640
 ] 

Hudson commented on AMBARI-13324:
-

SUCCESS: Integrated in Jenkins build Ambari-trunk-Commit #6530 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/6530/])
AMBARI-13324 automate creating Flume Keytab and principal (Shi Wang via (dili: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=d77f3a54fcbb79e9a2518a56bb78b0468a8a8b4f])
* (edit) 
ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/params.py
* (add) 
ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/kerberos.json
* (edit) 
ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/scripts/flume_check.py
* (edit) ambari-server/src/test/python/stacks/2.0.6/FLUME/test_service_check.py


> Ambari doesn't create Flume Kerberos principal + keytab
> ---
>
> Key: AMBARI-13324
> URL: https://issues.apache.org/jira/browse/AMBARI-13324
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 2.1.0
> Environment: HDP 2.3 + Kerberos MIT KDC
>Reporter: Hari Sekhon
>Assignee: Shi Wang
> Fix For: trunk
>
> Attachments: 
> 0001-AMBARI-13324-Ambari-doesn-t-create-Flume-Kerberos-pr.patch, 
> flume_kerberos.txt
>
>
> When deploying Kerberos via Ambari with MIT KDC, Ambari doesn't generate a 
> Kerberos principal and keytab for Flume.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19697) Uninstalled services including Ganglia is coming up in Config History-Service dropdown

2017-01-24 Thread Dhanya Balasundaran (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dhanya Balasundaran updated AMBARI-19697:
-
Description: 
- Navigate to dashboard page
- Choose 'Config History' tab
- Service dropdown has all services supported by the stack. It even shows 
Ganglia which is not supported now.
Checked on an older version and its not there.

  was:
- Navigate to dashboard page
- Choose 'Config History' tab
- In Service dropdown we have Ganglia which is not supported now.
Checked on an older version and its not there.


> Uninstalled services including Ganglia is coming up in Config History-Service 
> dropdown
> --
>
> Key: AMBARI-19697
> URL: https://issues.apache.org/jira/browse/AMBARI-19697
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Dhanya Balasundaran
> Fix For: 2.5.0
>
>
> - Navigate to dashboard page
> - Choose 'Config History' tab
> - Service dropdown has all services supported by the stack. It even shows 
> Ganglia which is not supported now.
> Checked on an older version and its not there.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19697) Uninstalled services including Ganglia is coming up in Config History-Service dropdown

2017-01-24 Thread Dhanya Balasundaran (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dhanya Balasundaran updated AMBARI-19697:
-
Summary: Uninstalled services including Ganglia is coming up in Config 
History-Service dropdown  (was: Ganglia is coming up in Config History-Service 
dropdown)

> Uninstalled services including Ganglia is coming up in Config History-Service 
> dropdown
> --
>
> Key: AMBARI-19697
> URL: https://issues.apache.org/jira/browse/AMBARI-19697
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-web
>Affects Versions: 2.5.0
>Reporter: Dhanya Balasundaran
> Fix For: 2.5.0
>
>
> - Navigate to dashboard page
> - Choose 'Config History' tab
> - In Service dropdown we have Ganglia which is not supported now.
> Checked on an older version and its not there.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (AMBARI-19699) Axis units and aggregators are wrong in some graphs of ambari grafana dashboards

2017-01-24 Thread Vivek Ratnavel Subramanian (JIRA)
Vivek Ratnavel Subramanian created AMBARI-19699:
---

 Summary: Axis units and aggregators are wrong in some graphs of 
ambari grafana dashboards
 Key: AMBARI-19699
 URL: https://issues.apache.org/jira/browse/AMBARI-19699
 Project: Ambari
  Issue Type: Bug
  Components: ambari-web
Affects Versions: 2.5.0
Reporter: Vivek Ratnavel Subramanian
Assignee: Vivek Ratnavel Subramanian
Priority: Minor
 Fix For: 2.5.0


Need to fix the following:
ReadAllQuery.HostRoleCommandEntity is missing a Y axis.
Total Cache Misses Y axis is wrong should not be time.
Remove Max aggregator from all metrics (JVM dashboard)
Cache Hits and Misses rate graphs aren't in the same units




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (AMBARI-19698) Author name in config history is not shown completely

2017-01-24 Thread Dhanya Balasundaran (JIRA)
Dhanya Balasundaran created AMBARI-19698:


 Summary: Author name in config history is not shown completely
 Key: AMBARI-19698
 URL: https://issues.apache.org/jira/browse/AMBARI-19698
 Project: Ambari
  Issue Type: Bug
  Components: ambari-web
Affects Versions: 2.5.0
Reporter: Dhanya Balasundaran
 Fix For: 2.5.0


Author name 'testuserconfighistory' is ellipsised and shown as 
'testuserconfigh...'in direct view as well as pop up view at the configs 
history.
Looks like there is no option for user to see the complete name of the author



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-18574) Set hbase.hregion.memstore.chunkpool.maxsize to 1.0

2017-01-24 Thread Ted Yu (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-18574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ted Yu updated AMBARI-18574:

Description: 
The default value for hbase.hregion.memstore.chunkpool.maxsize is:
{code}
  final static float POOL_MAX_SIZE_DEFAULT = 0.0f;
{code}

This would result in chunk pool being disabled, leading to excessive 
MemStoreLAB chunk allocations.

Ambari should set the value to 1.0

  was:
The default value for hbase.hregion.memstore.chunkpool.maxsize is:
{code}
  final static float POOL_MAX_SIZE_DEFAULT = 0.0f;
{code}
This would result in chunk pool being disabled, leading to excessive 
MemStoreLAB chunk allocations.

Ambari should set the value to 1.0


> Set hbase.hregion.memstore.chunkpool.maxsize to 1.0
> ---
>
> Key: AMBARI-18574
> URL: https://issues.apache.org/jira/browse/AMBARI-18574
> Project: Ambari
>  Issue Type: Bug
>Reporter: Ted Yu
>
> The default value for hbase.hregion.memstore.chunkpool.maxsize is:
> {code}
>   final static float POOL_MAX_SIZE_DEFAULT = 0.0f;
> {code}
> This would result in chunk pool being disabled, leading to excessive 
> MemStoreLAB chunk allocations.
> Ambari should set the value to 1.0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (AMBARI-19697) Ganglia is coming up in Config History-Service dropdown

2017-01-24 Thread Dhanya Balasundaran (JIRA)
Dhanya Balasundaran created AMBARI-19697:


 Summary: Ganglia is coming up in Config History-Service dropdown
 Key: AMBARI-19697
 URL: https://issues.apache.org/jira/browse/AMBARI-19697
 Project: Ambari
  Issue Type: Bug
  Components: ambari-web
Affects Versions: 2.5.0
Reporter: Dhanya Balasundaran
 Fix For: 2.5.0


- Navigate to dashboard page
- Choose 'Config History' tab
- In Service dropdown we have Ganglia which is not supported now.
Checked on an older version and its not there.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19695) Remove thrown exceptions while validating Kerberos Authentication configuration

2017-01-24 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836623#comment-15836623
 ] 

Hadoop QA commented on AMBARI-19695:


{color:green}+1 overall{color}.  Here are the results of testing the latest 
attachment 
  
http://issues.apache.org/jira/secure/attachment/12849132/AMBARI-19695.trunk.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:green}+1 tests included{color}.  The patch appears to include 1 new 
or modified test files.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
ambari-server.

Test results: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10231//testReport/
Console output: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10231//console

This message is automatically generated.

> Remove thrown exceptions while validating Kerberos Authentication 
> configuration
> ---
>
> Key: AMBARI-19695
> URL: https://issues.apache.org/jira/browse/AMBARI-19695
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 2.5.0
>Reporter: Eugene Chekanskiy
>Assignee: Eugene Chekanskiy
> Fix For: 2.5.0
>
> Attachments: AMBARI-19695.2.5.patch, AMBARI-19695.trunk.patch
>
>
> When starting Ambari where Kerberos authentication is enabled 
> (authentication.kerberos.enabled=true), Ambari validates the relevant 
> configuration properties. If a sever issue is found, an exception is thrown. 
> This causes issues in installations where Ambari is expected to be able to 
> perform Kerberos authentication but all of the data is available for since 
> this is it expected to be provided later. For example, the SPNEGO keytab file 
> will be created when Kerberos is enabled sometime after Ambari starts up.
> To prevent Ambari from shutting down when all the required data is not 
> available, thrown exceptions should be removed from 
> org.apache.ambari.server.configuration.Configuration#createKerberosAuthenticationProperties.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19681) Credential Store should add hadoop credential provider path property to all affected configuration types

2017-01-24 Thread Nahappan Somasundaram (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nahappan Somasundaram updated AMBARI-19681:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Committed to branch-2.5 and trunk

> Credential Store should add hadoop credential provider path property to all 
> affected configuration types
> 
>
> Key: AMBARI-19681
> URL: https://issues.apache.org/jira/browse/AMBARI-19681
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-agent
>Affects Versions: 2.5.0
>Reporter: Nahappan Somasundaram
>Assignee: Nahappan Somasundaram
> Fix For: 2.5.0
>
> Attachments: rb55853.patch
>
>
> CustomServiceOrchestrator.py function generateJceks adds the property 
> 'hadoop.security.credential.provider.path' only to the last configuration 
> type that requires it. The function iterates over the configtype_credentials 
> dictionary, and at each iteration it updates the variable named config (line 
> 272):
> {code}
> config = commandJson['configurations'][config_type]
> {code}
> After the iteration is over, and the provider_paths variable is set the 
> function adds the provider paths to the dictionary with the key 
> 'hadoop.security.credential.provider.path' (line 292)
> {code}
> config[self.CREDENTIAL_PROVIDER_PROPERTY_NAME] = ','.join(provider_paths)
> {code}
> The problem is that at this point the variable config contains the latest 
> config type that needs this property to be set up, while all of them should 
> have it! So if both config_type_1, and config_type_2 have passwords 
> properties present in configtype_credentials, only config_type_2 will have 
> the dictionary entry set for the key 
> 'hadoop.security.credential.provider.path', and it will contain a reference 
> to both of their jceks files!
> Another issue is that there is no reason to collect the provider paths to an 
> array, each config_type should have a reference only to it's own provider.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-13324) Ambari doesn't create Flume Kerberos principal + keytab

2017-01-24 Thread Di Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-13324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Di Li updated AMBARI-13324:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

> Ambari doesn't create Flume Kerberos principal + keytab
> ---
>
> Key: AMBARI-13324
> URL: https://issues.apache.org/jira/browse/AMBARI-13324
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 2.1.0
> Environment: HDP 2.3 + Kerberos MIT KDC
>Reporter: Hari Sekhon
>Assignee: Shi Wang
> Fix For: trunk
>
> Attachments: 
> 0001-AMBARI-13324-Ambari-doesn-t-create-Flume-Kerberos-pr.patch, 
> flume_kerberos.txt
>
>
> When deploying Kerberos via Ambari with MIT KDC, Ambari doesn't generate a 
> Kerberos principal and keytab for Flume.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-13324) Ambari doesn't create Flume Kerberos principal + keytab

2017-01-24 Thread Di Li (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-13324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836579#comment-15836579
 ] 

Di Li commented on AMBARI-13324:


pushed to trunk as 
https://git-wip-us.apache.org/repos/asf?p=ambari.git;a=commit;h=d77f3a54fcbb79e9a2518a56bb78b0468a8a8b4f

> Ambari doesn't create Flume Kerberos principal + keytab
> ---
>
> Key: AMBARI-13324
> URL: https://issues.apache.org/jira/browse/AMBARI-13324
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 2.1.0
> Environment: HDP 2.3 + Kerberos MIT KDC
>Reporter: Hari Sekhon
>Assignee: Shi Wang
> Fix For: trunk
>
> Attachments: 
> 0001-AMBARI-13324-Ambari-doesn-t-create-Flume-Kerberos-pr.patch, 
> flume_kerberos.txt
>
>
> When deploying Kerberos via Ambari with MIT KDC, Ambari doesn't generate a 
> Kerberos principal and keytab for Flume.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19681) Credential Store should add hadoop credential provider path property to all affected configuration types

2017-01-24 Thread Hadoop QA (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836542#comment-15836542
 ] 

Hadoop QA commented on AMBARI-19681:


{color:red}-1 overall{color}.  Here are the results of testing the latest 
attachment 
  http://issues.apache.org/jira/secure/attachment/12849145/rb55853.patch
  against trunk revision .

{color:green}+1 @author{color}.  The patch does not contain any @author 
tags.

{color:red}-1 tests included{color}.  The patch doesn't appear to include 
any new or modified tests.
Please justify why no new tests are needed for this 
patch.
Also please list what manual steps were performed to 
verify this patch.

{color:green}+1 javac{color}.  The applied patch does not increase the 
total number of javac compiler warnings.

{color:green}+1 release audit{color}.  The applied patch does not increase 
the total number of release audit warnings.

{color:green}+1 core tests{color}.  The patch passed unit tests in 
ambari-agent.

Test results: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10230//testReport/
Console output: 
https://builds.apache.org/job/Ambari-trunk-test-patch/10230//console

This message is automatically generated.

> Credential Store should add hadoop credential provider path property to all 
> affected configuration types
> 
>
> Key: AMBARI-19681
> URL: https://issues.apache.org/jira/browse/AMBARI-19681
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-agent
>Affects Versions: 2.5.0
>Reporter: Nahappan Somasundaram
>Assignee: Nahappan Somasundaram
> Fix For: 2.5.0
>
> Attachments: rb55853.patch
>
>
> CustomServiceOrchestrator.py function generateJceks adds the property 
> 'hadoop.security.credential.provider.path' only to the last configuration 
> type that requires it. The function iterates over the configtype_credentials 
> dictionary, and at each iteration it updates the variable named config (line 
> 272):
> {code}
> config = commandJson['configurations'][config_type]
> {code}
> After the iteration is over, and the provider_paths variable is set the 
> function adds the provider paths to the dictionary with the key 
> 'hadoop.security.credential.provider.path' (line 292)
> {code}
> config[self.CREDENTIAL_PROVIDER_PROPERTY_NAME] = ','.join(provider_paths)
> {code}
> The problem is that at this point the variable config contains the latest 
> config type that needs this property to be set up, while all of them should 
> have it! So if both config_type_1, and config_type_2 have passwords 
> properties present in configtype_credentials, only config_type_2 will have 
> the dictionary entry set for the key 
> 'hadoop.security.credential.provider.path', and it will contain a reference 
> to both of their jceks files!
> Another issue is that there is no reason to collect the provider paths to an 
> array, each config_type should have a reference only to it's own provider.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19685) Stack advisor needs to enforce component dependency for slaves and masters

2017-01-24 Thread Jaimin Jetly (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jaimin Jetly updated AMBARI-19685:
--
Attachment: AMBARI-19685.2.patch

> Stack advisor needs to enforce component dependency for slaves and masters
> --
>
> Key: AMBARI-19685
> URL: https://issues.apache.org/jira/browse/AMBARI-19685
> Project: Ambari
>  Issue Type: Task
>  Components: ambari-sever
>Affects Versions: 2.5.0
>Reporter: Jaimin Jetly
>Assignee: Jaimin Jetly
> Fix For: 3.0.0
>
> Attachments: AMBARI-19685.2.patch, AMBARI-19685.patch
>
>
> * Install Ambari cluster with latest trunk bits
> * Modify 
> /var/lib/ambari-server/resources/common-services/ZEPPELIN/0.6.0.2.5/metainfo.xml
>  to add the following:
> {noformat}
> Add to  node of ZEPPELIN_MASTER:
> 
>   SPARK/LIVY_SERVER
>   host
> 
> Add to  node:
>   
> SPARK
>   
> {noformat}
> * Install HDP 2.5.3 cluster with Spark
> * Once the cluster is installed, use Add Service Wizard to add Zeppelin
> * Assign Slaves and Clients step should appear (without the metainfo.xml 
> change, it will be skipped)
> * The user should not be able to proceed beyond this page unless at least one 
> Livy Server is selected <- this validation should be handled by the stack 
> advisor



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19592) Create grafana dashboards for Druid Metrics

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836521#comment-15836521
 ] 

Hudson commented on AMBARI-19592:
-

SUCCESS: Integrated in Jenkins build Ambari-branch-2.5 #787 (See 
[https://builds.apache.org/job/Ambari-branch-2.5/787/])
AMBARI-19592 : Create grafana dashboards for Druid Metrics and configure 
(avijayan: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=9bc595ef5719c6e63d432f012ab095beec0a70e1])
* (edit) 
ambari-server/src/main/resources/common-services/DRUID/0.9.2/configuration/druid-common.xml
* (add) 
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/files/grafana-dashboards/HDP/grafana-druid-home.json
* (add) 
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/files/grafana-dashboards/HDP/grafana-druid-ingestion.json
* (edit) ambari-metrics/ambari-metrics-grafana/ambari-metrics/datasource.js
* (add) 
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/files/grafana-dashboards/HDP/grafana-druid-query.json
* (edit) 
ambari-server/src/main/resources/common-services/DRUID/0.9.2/package/scripts/params.py
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.6/services/stack_advisor.py


> Create grafana dashboards for Druid Metrics
> ---
>
> Key: AMBARI-19592
> URL: https://issues.apache.org/jira/browse/AMBARI-19592
> Project: Ambari
>  Issue Type: Task
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
> Fix For: trunk, 2.5.0
>
> Attachments: ambari-19592.patch
>
>
> Druid can now ingest metrics to ambari-metrics-server. 
> Add grafana dashboards for druid metrics. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-13324) Ambari doesn't create Flume Kerberos principal + keytab

2017-01-24 Thread Shi Wang (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-13324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shi Wang updated AMBARI-13324:
--
Attachment: (was: 0001-AMBARI-13324-createFlumeKeytab.patch)

> Ambari doesn't create Flume Kerberos principal + keytab
> ---
>
> Key: AMBARI-13324
> URL: https://issues.apache.org/jira/browse/AMBARI-13324
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 2.1.0
> Environment: HDP 2.3 + Kerberos MIT KDC
>Reporter: Hari Sekhon
>Assignee: Shi Wang
> Fix For: trunk
>
> Attachments: 
> 0001-AMBARI-13324-Ambari-doesn-t-create-Flume-Kerberos-pr.patch, 
> flume_kerberos.txt
>
>
> When deploying Kerberos via Ambari with MIT KDC, Ambari doesn't generate a 
> Kerberos principal and keytab for Flume.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-13324) Ambari doesn't create Flume Kerberos principal + keytab

2017-01-24 Thread Shi Wang (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-13324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shi Wang updated AMBARI-13324:
--
Attachment: 0001-AMBARI-13324-Ambari-doesn-t-create-Flume-Kerberos-pr.patch

> Ambari doesn't create Flume Kerberos principal + keytab
> ---
>
> Key: AMBARI-13324
> URL: https://issues.apache.org/jira/browse/AMBARI-13324
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 2.1.0
> Environment: HDP 2.3 + Kerberos MIT KDC
>Reporter: Hari Sekhon
>Assignee: Shi Wang
> Fix For: trunk
>
> Attachments: 
> 0001-AMBARI-13324-Ambari-doesn-t-create-Flume-Kerberos-pr.patch, 
> flume_kerberos.txt
>
>
> When deploying Kerberos via Ambari with MIT KDC, Ambari doesn't generate a 
> Kerberos principal and keytab for Flume.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19592) Create grafana dashboards for Druid Metrics

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836519#comment-15836519
 ] 

Hudson commented on AMBARI-19592:
-

FAILURE: Integrated in Jenkins build Ambari-trunk-Commit #6529 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/6529/])
AMBARI-19592 : Create grafana dashboards for Druid Metrics and configure 
(avijayan: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=ad0f4ecc67e39d109449e945b5108440059b4240])
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.6/services/stack_advisor.py
* (add) 
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/files/grafana-dashboards/HDP/grafana-druid-home.json
* (add) 
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/files/grafana-dashboards/HDP/grafana-druid-ingestion.json
* (add) 
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/files/grafana-dashboards/HDP/grafana-druid-query.json
* (edit) 
ambari-server/src/main/resources/common-services/DRUID/0.9.2/package/scripts/params.py
* (edit) ambari-metrics/ambari-metrics-grafana/ambari-metrics/datasource.js
* (edit) 
ambari-server/src/main/resources/common-services/DRUID/0.9.2/configuration/druid-common.xml


> Create grafana dashboards for Druid Metrics
> ---
>
> Key: AMBARI-19592
> URL: https://issues.apache.org/jira/browse/AMBARI-19592
> Project: Ambari
>  Issue Type: Task
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
> Fix For: trunk, 2.5.0
>
> Attachments: ambari-19592.patch
>
>
> Druid can now ingest metrics to ambari-metrics-server. 
> Add grafana dashboards for druid metrics. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19668) Supporting zookeeper security only from HDP 2.6

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836518#comment-15836518
 ] 

Hudson commented on AMBARI-19668:
-

FAILURE: Integrated in Jenkins build Ambari-trunk-Commit #6529 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/6529/])
AMBARI-19668. Supporting zookeeper security only from HDP 2.6. (Attila 
(stoader: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=d0dc19e0c95000a87884029ddb6c7ab4f3f32fb7])
* (edit) 
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/oozie_server.py
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.4/services/HDFS/configuration/hadoop-env.xml
* (edit) 
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/configuration/hadoop-env.xml
* (add) 
ambari-server/src/main/resources/stacks/HDP/2.6/services/OOZIE/kerberos.json
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/services/HDFS/configuration/hadoop-env.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/3.0/properties/stack_features.json
* (edit) 
ambari-server/src/main/resources/common-services/OOZIE/4.2.0.2.3/kerberos.json
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-ANY/scripts/params.py
* (add) 
ambari-server/src/main/resources/stacks/HDP/2.6/services/HDFS/kerberos.json
* (edit) 
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/kerberos.json
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.2/services/HDFS/configuration/hadoop-env.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.5/services/HDFS/kerberos.json
* (edit) 
ambari-server/src/main/resources/stacks/HDP/3.0/hooks/before-ANY/scripts/params.py
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.5/services/YARN/kerberos.json
* (add) 
ambari-server/src/main/resources/stacks/HDP/2.6/services/HDFS/configuration/hadoop-env.xml
* (edit) 
ambari-server/src/main/resources/stacks/HDP/3.0/services/HDFS/configuration/hadoop-env.xml
* (edit) 
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/resourcemanager.py
* (edit) 
ambari-server/src/main/resources/common-services/OOZIE/4.0.0.2.0/package/scripts/params_linux.py
* (edit) 
ambari-server/src/main/resources/common-services/YARN/2.1.0.2.0/package/scripts/params_linux.py
* (edit) 
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/kerberos.json
* (edit) 
ambari-server/src/main/resources/common-services/YARN/3.0.0.3.0/kerberos.json
* (edit) 
ambari-server/src/main/resources/common-services/HDFS/3.0.0.3.0/package/scripts/params_linux.py
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3.ECS/services/YARN/kerberos.json
* (edit) 
ambari-server/src/main/resources/stacks/PERF/1.0/properties/stack_features.json
* (edit) 
contrib/management-packs/hdf-ambari-mpack/src/main/resources/stacks/HDF/2.0/properties/stack_features.json
* (edit) 
ambari-server/src/main/resources/common-services/HDFS/3.0.0.3.0/package/scripts/zkfc_slave.py
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.2/services/YARN/kerberos.json
* (edit) 
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/zkfc_slave.py
* (edit) ambari-server/src/test/python/stacks/2.0.6/HDFS/test_zkfc.py
* (edit) 
ambari-common/src/main/python/resource_management/libraries/functions/constants.py
* (edit) 
ambari-server/src/main/resources/common-services/HDFS/2.1.0.2.0/package/scripts/params_linux.py
* (add) 
ambari-server/src/main/resources/stacks/HDP/2.6/services/YARN/kerberos.json
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.0.6/properties/stack_features.json
* (edit) 
ambari-server/src/main/resources/stacks/HDP/2.3/services/YARN/kerberos.json


> Supporting zookeeper security only from HDP 2.6
> ---
>
> Key: AMBARI-19668
> URL: https://issues.apache.org/jira/browse/AMBARI-19668
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-agent, ambari-server
>Affects Versions: 2.5.0
>Reporter: Attila Magyar
>Assignee: Attila Magyar
> Fix For: 2.5.0
>
> Attachments: AMBARI-19668_branch-2.5.patch, AMBARI-19668_trunk.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (AMBARI-19696) Move HS2 does not install dependent components on the target host

2017-01-24 Thread Andrii Tkach (JIRA)
Andrii Tkach created AMBARI-19696:
-

 Summary: Move HS2 does not install dependent components on the 
target host
 Key: AMBARI-19696
 URL: https://issues.apache.org/jira/browse/AMBARI-19696
 Project: Ambari
  Issue Type: Bug
  Components: ambari-web
Affects Versions: 2.5.0
Reporter: Andrii Tkach
Assignee: Andrii Tkach
Priority: Critical
 Fix For: 2.5.0


Fix the Move Wizard to install the dependencies automatically as we do in 
Install/Add Service Wizards.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (AMBARI-19689) Error on Files view-SIMPLE authentication is not enabled

2017-01-24 Thread Hudson (JIRA)

[ 
https://issues.apache.org/jira/browse/AMBARI-19689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836464#comment-15836464
 ] 

Hudson commented on AMBARI-19689:
-

ABORTED: Integrated in Jenkins build Ambari-trunk-Commit #6528 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/6528/])
AMBARI-19689. Error on Files view-SIMPLE authentication is not enabled. 
(grvngr: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git=commit=75b30a4e974bce0df3cd9d2d0efc428f101d8601])
* (edit) 
contrib/views/utils/src/main/java/org/apache/ambari/view/utils/hdfs/ConfigurationBuilder.java


> Error on Files view-SIMPLE authentication is not enabled
> 
>
> Key: AMBARI-19689
> URL: https://issues.apache.org/jira/browse/AMBARI-19689
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-views
>Affects Versions: 2.5.0
>Reporter: Gaurav Nagar
>Assignee: Gaurav Nagar
> Fix For: 2.5.0
>
> Attachments: AMBARI-19689_trunk.patch
>
>
> 20 Jan 2017 09:07:12,659  INFO [ambari-client-thread-17242] HdfsUtil:151 - 
> HdfsApi connected OK
> 20 Jan 2017 09:07:12,661  INFO [ambari-client-thread-17242] 
> TrashPolicyDefault:87 - Namenode trash configuration: Deletion interval = 360 
> minutes, Emptier interval = 0 minutes.
> 20 Jan 2017 09:07:12,664  WARN [ambari-client-thread-17242] 
> RetryInvocationHandler:217 - Exception while invoking 
> ClientNamenodeProtocolTranslatorPB.getFileInfo over null. Not retrying 
> because try once and fail.
> org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException):
>  SIMPLE authentication is not enabled.  Available:[TOKEN, KERBEROS]
>   at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1552)
>   at org.apache.hadoop.ipc.Client.call(Client.java:1496)
>   at org.apache.hadoop.ipc.Client.call(Client.java:1396)
>   at 
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:233)
>   at com.sun.proxy.$Proxy171.getFileInfo(Unknown Source)
>   at 
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:816)
>   at sun.reflect.GeneratedMethodAccessor844.invoke(Unknown Source)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:278)
>   at 
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:194)
>   at 
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:176)
>   at com.sun.proxy.$Proxy172.getFileInfo(Unknown Source)
>   at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2158)
>   at 
> org.apache.hadoop.hdfs.DistributedFileSystem$25.doCall(DistributedFileSystem.java:1423)
>   at 
> org.apache.hadoop.hdfs.DistributedFileSystem$25.doCall(DistributedFileSystem.java:1419)
>   at 
> org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
>   at 
> org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1419)
>   at org.apache.ambari.view.utils.hdfs.HdfsApi$3.run(HdfsApi.java:130)
>   at org.apache.ambari.view.utils.hdfs.HdfsApi$3.run(HdfsApi.java:128)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at javax.security.auth.Subject.doAs(Subject.java:422)
>   at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
>   at org.apache.ambari.view.utils.hdfs.HdfsApi.execute(HdfsApi.java:400)
>   at 
> org.apache.ambari.view.utils.hdfs.HdfsApi.getFileStatus(HdfsApi.java:128)
>   at 
> org.apache.ambari.view.commons.hdfs.UserService.trashdir(UserService.java:105)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:498)
>   at 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>   at 
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)
>   at 
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>   at 
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:302)
>   at 
> 

[jira] [Updated] (AMBARI-19686) Add condition for detecting Blueprint call so that 'llap' named queue can be created on 1st BP invocation, if deemed required.

2017-01-24 Thread Swapan Shridhar (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Swapan Shridhar updated AMBARI-19686:
-
Resolution: Fixed
Status: Resolved  (was: Patch Available)

> Add condition for detecting Blueprint call so that 'llap' named queue can be 
> created on 1st BP invocation, if deemed required.
> --
>
> Key: AMBARI-19686
> URL: https://issues.apache.org/jira/browse/AMBARI-19686
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-server
>Affects Versions: 2.5.0
>Reporter: Swapan Shridhar
>Assignee: Swapan Shridhar
>Priority: Blocker
> Fix For: 2.5.0
>
> Attachments: AMBARI-19686.patch
>
>
> - The 1st BP call is not getting the 'llap' named queue created, and is 
> expected to create the queue. In the same scenario, where we enable Hive 
> Server Interactive (HSI) from UI, the queue gets created.
> *Issue:*
> - The current code is checking if there is *enable_hive_interactive* in 
> changed-configurations, then only allow queue creation, implying 1st 
> invocation. This is not true for BP 1st time invocation where HSI would be 
> started.
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19681) Credential Store should add hadoop credential provider path property to all affected configuration types

2017-01-24 Thread Nahappan Somasundaram (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nahappan Somasundaram updated AMBARI-19681:
---
Attachment: (was: BUG-72951.patch)

> Credential Store should add hadoop credential provider path property to all 
> affected configuration types
> 
>
> Key: AMBARI-19681
> URL: https://issues.apache.org/jira/browse/AMBARI-19681
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-agent
>Affects Versions: 2.5.0
>Reporter: Nahappan Somasundaram
>Assignee: Nahappan Somasundaram
> Fix For: 2.5.0
>
> Attachments: rb55853.patch
>
>
> CustomServiceOrchestrator.py function generateJceks adds the property 
> 'hadoop.security.credential.provider.path' only to the last configuration 
> type that requires it. The function iterates over the configtype_credentials 
> dictionary, and at each iteration it updates the variable named config (line 
> 272):
> {code}
> config = commandJson['configurations'][config_type]
> {code}
> After the iteration is over, and the provider_paths variable is set the 
> function adds the provider paths to the dictionary with the key 
> 'hadoop.security.credential.provider.path' (line 292)
> {code}
> config[self.CREDENTIAL_PROVIDER_PROPERTY_NAME] = ','.join(provider_paths)
> {code}
> The problem is that at this point the variable config contains the latest 
> config type that needs this property to be set up, while all of them should 
> have it! So if both config_type_1, and config_type_2 have passwords 
> properties present in configtype_credentials, only config_type_2 will have 
> the dictionary entry set for the key 
> 'hadoop.security.credential.provider.path', and it will contain a reference 
> to both of their jceks files!
> Another issue is that there is no reason to collect the provider paths to an 
> array, each config_type should have a reference only to it's own provider.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19592) Create grafana dashboards for Druid Metrics

2017-01-24 Thread Aravindan Vijayan (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Aravindan Vijayan updated AMBARI-19592:
---
Resolution: Fixed
Status: Resolved  (was: Patch Available)

Pushed to 

branch-2.5 
{code}
commit 9bc595ef5719c6e63d432f012ab095beec0a70e1
Author: Aravindan Vijayan 
Date:   Tue Jan 24 10:51:18 2017 -0800

AMBARI-19592 : Create grafana dashboards for Druid Metrics and configure 
druid to send metrics to AMS. (Nishant Bangarwa via avijayan)
{code}

and trunk.
{code}
commit ad0f4ecc67e39d109449e945b5108440059b4240
Author: Aravindan Vijayan 
Date:   Tue Jan 24 10:52:56 2017 -0800

AMBARI-19592 : Create grafana dashboards for Druid Metrics and configure 
druid to send metrics to AMS. (Nishant Bangarwa via avijayan)

{code}


> Create grafana dashboards for Druid Metrics
> ---
>
> Key: AMBARI-19592
> URL: https://issues.apache.org/jira/browse/AMBARI-19592
> Project: Ambari
>  Issue Type: Task
>Reporter: Nishant Bangarwa
>Assignee: Nishant Bangarwa
> Fix For: trunk, 2.5.0
>
> Attachments: ambari-19592.patch
>
>
> Druid can now ingest metrics to ambari-metrics-server. 
> Add grafana dashboards for druid metrics. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19681) Credential Store should add hadoop credential provider path property to all affected configuration types

2017-01-24 Thread Nahappan Somasundaram (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nahappan Somasundaram updated AMBARI-19681:
---
Attachment: rb55853.patch

> Credential Store should add hadoop credential provider path property to all 
> affected configuration types
> 
>
> Key: AMBARI-19681
> URL: https://issues.apache.org/jira/browse/AMBARI-19681
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-agent
>Affects Versions: 2.5.0
>Reporter: Nahappan Somasundaram
>Assignee: Nahappan Somasundaram
> Fix For: 2.5.0
>
> Attachments: BUG-72951.patch, rb55853.patch
>
>
> CustomServiceOrchestrator.py function generateJceks adds the property 
> 'hadoop.security.credential.provider.path' only to the last configuration 
> type that requires it. The function iterates over the configtype_credentials 
> dictionary, and at each iteration it updates the variable named config (line 
> 272):
> {code}
> config = commandJson['configurations'][config_type]
> {code}
> After the iteration is over, and the provider_paths variable is set the 
> function adds the provider paths to the dictionary with the key 
> 'hadoop.security.credential.provider.path' (line 292)
> {code}
> config[self.CREDENTIAL_PROVIDER_PROPERTY_NAME] = ','.join(provider_paths)
> {code}
> The problem is that at this point the variable config contains the latest 
> config type that needs this property to be set up, while all of them should 
> have it! So if both config_type_1, and config_type_2 have passwords 
> properties present in configtype_credentials, only config_type_2 will have 
> the dictionary entry set for the key 
> 'hadoop.security.credential.provider.path', and it will contain a reference 
> to both of their jceks files!
> Another issue is that there is no reason to collect the provider paths to an 
> array, each config_type should have a reference only to it's own provider.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19681) Credential Store should add hadoop credential provider path property to all affected configuration types

2017-01-24 Thread Nahappan Somasundaram (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nahappan Somasundaram updated AMBARI-19681:
---
Status: Patch Available  (was: Open)

> Credential Store should add hadoop credential provider path property to all 
> affected configuration types
> 
>
> Key: AMBARI-19681
> URL: https://issues.apache.org/jira/browse/AMBARI-19681
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-agent
>Affects Versions: 2.5.0
>Reporter: Nahappan Somasundaram
>Assignee: Nahappan Somasundaram
> Fix For: 2.5.0
>
> Attachments: rb55853.patch
>
>
> CustomServiceOrchestrator.py function generateJceks adds the property 
> 'hadoop.security.credential.provider.path' only to the last configuration 
> type that requires it. The function iterates over the configtype_credentials 
> dictionary, and at each iteration it updates the variable named config (line 
> 272):
> {code}
> config = commandJson['configurations'][config_type]
> {code}
> After the iteration is over, and the provider_paths variable is set the 
> function adds the provider paths to the dictionary with the key 
> 'hadoop.security.credential.provider.path' (line 292)
> {code}
> config[self.CREDENTIAL_PROVIDER_PROPERTY_NAME] = ','.join(provider_paths)
> {code}
> The problem is that at this point the variable config contains the latest 
> config type that needs this property to be set up, while all of them should 
> have it! So if both config_type_1, and config_type_2 have passwords 
> properties present in configtype_credentials, only config_type_2 will have 
> the dictionary entry set for the key 
> 'hadoop.security.credential.provider.path', and it will contain a reference 
> to both of their jceks files!
> Another issue is that there is no reason to collect the provider paths to an 
> array, each config_type should have a reference only to it's own provider.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (AMBARI-19681) Credential Store should add hadoop credential provider path property to all affected configuration types

2017-01-24 Thread Nahappan Somasundaram (JIRA)

 [ 
https://issues.apache.org/jira/browse/AMBARI-19681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Nahappan Somasundaram updated AMBARI-19681:
---
Status: Open  (was: Patch Available)

> Credential Store should add hadoop credential provider path property to all 
> affected configuration types
> 
>
> Key: AMBARI-19681
> URL: https://issues.apache.org/jira/browse/AMBARI-19681
> Project: Ambari
>  Issue Type: Bug
>  Components: ambari-agent
>Affects Versions: 2.5.0
>Reporter: Nahappan Somasundaram
>Assignee: Nahappan Somasundaram
> Fix For: 2.5.0
>
> Attachments: rb55853.patch
>
>
> CustomServiceOrchestrator.py function generateJceks adds the property 
> 'hadoop.security.credential.provider.path' only to the last configuration 
> type that requires it. The function iterates over the configtype_credentials 
> dictionary, and at each iteration it updates the variable named config (line 
> 272):
> {code}
> config = commandJson['configurations'][config_type]
> {code}
> After the iteration is over, and the provider_paths variable is set the 
> function adds the provider paths to the dictionary with the key 
> 'hadoop.security.credential.provider.path' (line 292)
> {code}
> config[self.CREDENTIAL_PROVIDER_PROPERTY_NAME] = ','.join(provider_paths)
> {code}
> The problem is that at this point the variable config contains the latest 
> config type that needs this property to be set up, while all of them should 
> have it! So if both config_type_1, and config_type_2 have passwords 
> properties present in configtype_credentials, only config_type_2 will have 
> the dictionary entry set for the key 
> 'hadoop.security.credential.provider.path', and it will contain a reference 
> to both of their jceks files!
> Another issue is that there is no reason to collect the provider paths to an 
> array, each config_type should have a reference only to it's own provider.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)