[jira] [Commented] (YARN-2588) Standby RM does not transitionToActive if previous transitionToActive is failed with ZK exception.

2014-10-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189698#comment-14189698 ] Karthik Kambatla commented on YARN-2588: Agree, we will need to move things around

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189707#comment-14189707 ] Hadoop QA commented on YARN-2753: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2712) Adding tests about FSQueue and headroom of FairScheduler to TestWorkPreservingRMRestart

2014-10-30 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189720#comment-14189720 ] Tsuyoshi OZAWA commented on YARN-2712: -- [~adhoot] [~kkambatl] [~jianhe] do you have

[jira] [Commented] (YARN-2771) DistributedShell's DSConstants are badly named

2014-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189724#comment-14189724 ] Hadoop QA commented on YARN-2771: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2712) Adding tests about FSQueue and headroom of FairScheduler to TestWorkPreservingRMRestart

2014-10-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189742#comment-14189742 ] Karthik Kambatla commented on YARN-2712: LGTM, +1. Adding tests about FSQueue and

[jira] [Updated] (YARN-2712) TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checks

2014-10-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2712: --- Summary: TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checks (was:

[jira] [Commented] (YARN-2712) TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checks

2014-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189754#comment-14189754 ] Hudson commented on YARN-2712: -- FAILURE: Integrated in Hadoop-trunk-Commit #6392 (See

[jira] [Created] (YARN-2775) There is no close method in NMWebServices#getLogs()

2014-10-30 Thread skrho (JIRA)
skrho created YARN-2775: --- Summary: There is no close method in NMWebServices#getLogs() Key: YARN-2775 URL: https://issues.apache.org/jira/browse/YARN-2775 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-2775) There is no close method in NMWebServices#getLogs()

2014-10-30 Thread skrho (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] skrho updated YARN-2775: Attachment: YARN-2775_001.patch I added close method.. so fileInputStream object is not accumulated in memory.. How

[jira] [Commented] (YARN-2712) TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checks

2014-10-30 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189835#comment-14189835 ] Tsuyoshi OZAWA commented on YARN-2712: -- Thanks Anubhav and Karhitk for the reviews.

[jira] [Created] (YARN-2776) In HA mode, can't set ip but hostname to yarn.resourcemanager.webapp.address.*

2014-10-30 Thread meiyoula (JIRA)
meiyoula created YARN-2776: -- Summary: In HA mode, can't set ip but hostname to yarn.resourcemanager.webapp.address.* Key: YARN-2776 URL: https://issues.apache.org/jira/browse/YARN-2776 Project: Hadoop YARN

[jira] [Updated] (YARN-2776) In HA mode, can't set ip but hostname to yarn.resourcemanager.webapp.address.*

2014-10-30 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated YARN-2776: --- Attachment: YARN-2766.patch In HA mode, can't set ip but hostname to yarn.resourcemanager.webapp.address.*

[jira] [Updated] (YARN-2776) In HA mode, can't set ip but hostname to yarn.resourcemanager.webapp.address.*

2014-10-30 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated YARN-2776: --- Description: In HA mode, when setting yarn.resourcemanager.webapp.address.* with ip:port, I run a spark

[jira] [Updated] (YARN-2776) In HA mode, can't set ip but hostname to yarn.resourcemanager.webapp.address.*

2014-10-30 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated YARN-2776: --- Description: In HA mode, when setting yarn.resourcemanager.webapp.address.* with ip:port, I run a spark

[jira] [Updated] (YARN-2776) In HA mode, can't set ip but hostname to yarn.resourcemanager.webapp.address.*

2014-10-30 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated YARN-2776: --- Description: In HA mode, when setting yarn.resourcemanager.webapp.address.* with ip:port, I run a spark

[jira] [Updated] (YARN-2776) In HA mode, can't set ip but hostname to yarn.resourcemanager.webapp.address.*

2014-10-30 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] meiyoula updated YARN-2776: --- Description: In HA mode, when setting yarn.resourcemanager.webapp.address.* with ip:port, I run a spark

[jira] [Updated] (YARN-2762) Provide RMAdminCLI args validation for NodeLabelManager operations

2014-10-30 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-2762: - Issue Type: Sub-task (was: Improvement) Parent: YARN-2492 Provide RMAdminCLI args validation for

[jira] [Commented] (YARN-2765) Add leveldb-based implementation for RMStateStore

2014-10-30 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189934#comment-14189934 ] Tsuyoshi OZAWA commented on YARN-2765: -- Currently we can assume that

[jira] [Commented] (YARN-2742) FairSchedulerConfiguration should allow extra spaces between value and unit

2014-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189970#comment-14189970 ] Hudson commented on YARN-2742: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #728 (See

[jira] [Commented] (YARN-2769) Timeline server domain not set correctly when using shell_command on Windows

2014-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189965#comment-14189965 ] Hudson commented on YARN-2769: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #728 (See

[jira] [Commented] (YARN-2712) TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checks

2014-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189973#comment-14189973 ] Hudson commented on YARN-2712: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #728 (See

[jira] [Commented] (YARN-2742) FairSchedulerConfiguration should allow extra spaces between value and unit

2014-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190084#comment-14190084 ] Hudson commented on YARN-2742: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1917 (See

[jira] [Commented] (YARN-2712) TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checks

2014-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190087#comment-14190087 ] Hudson commented on YARN-2712: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1917 (See

[jira] [Commented] (YARN-2769) Timeline server domain not set correctly when using shell_command on Windows

2014-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190079#comment-14190079 ] Hudson commented on YARN-2769: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1917 (See

[jira] [Updated] (YARN-2677) registry punycoding of usernames doesn't fix all usernames to be DNS-valid

2014-10-30 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2677: - Attachment: YARN-2677-002.patch Updated patch which also converts usernames to lower case (english

[jira] [Commented] (YARN-2677) registry punycoding of usernames doesn't fix all usernames to be DNS-valid

2014-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190151#comment-14190151 ] Hadoop QA commented on YARN-2677: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2755) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

2014-10-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190172#comment-14190172 ] Jason Lowe commented on YARN-2755: -- +1, committing this. NM fails to clean up

[jira] [Updated] (YARN-2776) In HA mode, can't set ip but hostname to yarn.resourcemanager.webapp.address.*

2014-10-30 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2776: --- Priority: Major (was: Critical) In HA mode, can't set ip but hostname to

[jira] [Commented] (YARN-2769) Timeline server domain not set correctly when using shell_command on Windows

2014-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190200#comment-14190200 ] Hudson commented on YARN-2769: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1942 (See

[jira] [Commented] (YARN-2712) TestWorkPreservingRMRestart: Augment FS tests with queue and headroom checks

2014-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190208#comment-14190208 ] Hudson commented on YARN-2712: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1942 (See

[jira] [Commented] (YARN-2742) FairSchedulerConfiguration should allow extra spaces between value and unit

2014-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190205#comment-14190205 ] Hudson commented on YARN-2742: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1942 (See

[jira] [Commented] (YARN-2755) NM fails to clean up usercache_DEL_timestamp dirs after YARN-661

2014-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190221#comment-14190221 ] Hudson commented on YARN-2755: -- FAILURE: Integrated in Hadoop-trunk-Commit #6393 (See

[jira] [Commented] (YARN-661) NM fails to cleanup local directories for users

2014-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190220#comment-14190220 ] Hudson commented on YARN-661: - FAILURE: Integrated in Hadoop-trunk-Commit #6393 (See

[jira] [Created] (YARN-2777) Mark the end of individual log in aggregated log

2014-10-30 Thread Ted Yu (JIRA)
Ted Yu created YARN-2777: Summary: Mark the end of individual log in aggregated log Key: YARN-2777 URL: https://issues.apache.org/jira/browse/YARN-2777 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService

2014-10-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2698: - Summary: Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService (was: Move

[jira] [Updated] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService

2014-10-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2698: - Description: YARN AdminService should have write API only, for other read APIs, they should be located at

[jira] [Commented] (YARN-2771) DistributedShell's DSConstants are badly named

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190430#comment-14190430 ] Zhijie Shen commented on YARN-2771: --- Constant name changes. No need for test case.

[jira] [Created] (YARN-2778) YARN node CLI should display labels on returned node reports

2014-10-30 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-2778: Summary: YARN node CLI should display labels on returned node reports Key: YARN-2778 URL: https://issues.apache.org/jira/browse/YARN-2778 Project: Hadoop YARN

[jira] [Commented] (YARN-2727) In RMAdminCLI usage display, instead of yarn.node-labels.fs-store.root-dir, yarn.node-labels.fs-store.uri is being displayed

2014-10-30 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190473#comment-14190473 ] Naganarasimha G R commented on YARN-2727: - Seems like failure is not due to this

[jira] [Updated] (YARN-2772) DistributedShell's timeline related options are not clear

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2772: -- Attachment: YARN-2772.2.patch Make one improvement. If failure happens when creating a domain, the

[jira] [Updated] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2014-10-30 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2495: Attachment: YARN-2495.20141031-1.patch Updated with fixes for all review comments,testcases

[jira] [Updated] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2014-10-30 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2729: Attachment: YARN-2729.20141031-1.patch Updated with review comments and test cases Support

[jira] [Commented] (YARN-2772) DistributedShell's timeline related options are not clear

2014-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190566#comment-14190566 ] Hadoop QA commented on YARN-2772: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService

2014-10-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2698: - Attachment: YARN-2698-20141030-1.patch Attached patch contains get node reports Move

[jira] [Updated] (YARN-2771) DistributedShell's DSConstants are badly named

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2771: -- Attachment: YARN-2771.2.patch Just realized I've missed one suggestion from Vinod in the description. I

[jira] [Created] (YARN-2779) SystemMetricsPublisher needs to renew and cancel timeline DT too

2014-10-30 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2779: - Summary: SystemMetricsPublisher needs to renew and cancel timeline DT too Key: YARN-2779 URL: https://issues.apache.org/jira/browse/YARN-2779 Project: Hadoop YARN

[jira] [Commented] (YARN-2771) DistributedShell's DSConstants are badly named

2014-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190685#comment-14190685 ] Hadoop QA commented on YARN-2771: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2766) ApplicationHistoryManager is expected to return a sorted list of apps/attempts/containers

2014-10-30 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-2766: Attachment: YARN-2766.patch Makes sense. The new patch updates

[jira] [Created] (YARN-2780) Log aggregated resource allocation in rm-appsummary.log

2014-10-30 Thread Koji Noguchi (JIRA)
Koji Noguchi created YARN-2780: -- Summary: Log aggregated resource allocation in rm-appsummary.log Key: YARN-2780 URL: https://issues.apache.org/jira/browse/YARN-2780 Project: Hadoop YARN Issue

[jira] [Assigned] (YARN-2780) Log aggregated resource allocation in rm-appsummary.log

2014-10-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-2780: Assignee: Eric Payne Log aggregated resource allocation in rm-appsummary.log

[jira] [Created] (YARN-2781) support more flexible policy for uploading in shared cache

2014-10-30 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-2781: - Summary: support more flexible policy for uploading in shared cache Key: YARN-2781 URL: https://issues.apache.org/jira/browse/YARN-2781 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-2766) ApplicationHistoryManager is expected to return a sorted list of apps/attempts/containers

2014-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190820#comment-14190820 ] Hadoop QA commented on YARN-2766: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2677) registry punycoding of usernames doesn't fix all usernames to be DNS-valid

2014-10-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated YARN-2677: Hadoop Flags: Reviewed +1 for the patch. I verified this on both Mac and Windows. Thanks, Steve!

[jira] [Commented] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

2014-10-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190855#comment-14190855 ] Jian He commented on YARN-2770: --- thanks Zhijie ! some comments: -

[jira] [Commented] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService

2014-10-30 Thread Wangda Tan (JIRA)
Assignee: Wangda Tan Priority: Critical Attachments: YARN-2698-20141028-1.patch, YARN-2698-20141028-2.patch, YARN-2698-20141028-3.patch, YARN-2698-20141029-1.patch, YARN-2698-20141029-2.patch, YARN-2698-20141030-1.patch YARN AdminService should have write API only, for other

[jira] [Commented] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService

2014-10-30 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12678275/YARN-2698-20141030-1.patch against trunk revision c2866ac. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears

[jira] [Resolved] (YARN-2779) SystemMetricsPublisher needs to renew and cancel timeline DT too

2014-10-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-2779. --- Resolution: Invalid This doesn't make any sense. RM can simply use kerberos

[jira] [Commented] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService

2014-10-30 Thread Wangda Tan (JIRA)
-2698-20141028-3.patch, YARN-2698-20141029-1.patch, YARN-2698-20141029-2.patch, YARN-2698-20141030-1.patch YARN AdminService should have write API only, for other read APIs, they should be located at RM ClientService. Include, 1) getClusterNodeLabels 2) getNodeToLabels 3) getNodeReport should

[jira] [Commented] (YARN-2730) Only one localizer can run on a NodeManager at a time

2014-10-30 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190947#comment-14190947 ] Siqi Li commented on YARN-2730: --- [~jlowe] Hi Jason, do you have some time to take a look at

[jira] [Updated] (YARN-2778) YARN node CLI should display labels on returned node reports

2014-10-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2778: - Attachment: YARN-2778-20141030-1.patch YARN node CLI should display labels on returned node reports

[jira] [Reopened] (YARN-2779) SystemMetricsPublisher needs to renew and cancel timeline DT too

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reopened YARN-2779: --- SystemMetricsPublisher needs to renew and cancel timeline DT too

[jira] [Commented] (YARN-2779) SystemMetricsPublisher needs to renew and cancel timeline DT too

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190955#comment-14190955 ] Zhijie Shen commented on YARN-2779: --- [~vinodkv], in the current code base, we're

[jira] [Updated] (YARN-2779) SystemMetricsPublisher can use Kerberos directly instead of timeline DT

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2779: -- Summary: SystemMetricsPublisher can use Kerberos directly instead of timeline DT (was:

[jira] [Commented] (YARN-2677) registry punycoding of usernames doesn't fix all usernames to be DNS-valid

2014-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190971#comment-14190971 ] Hudson commented on YARN-2677: -- SUCCESS: Integrated in Hadoop-trunk-Commit #6399 (See

[jira] [Commented] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

2014-10-30 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190998#comment-14190998 ] Vinod Kumar Vavilapalli commented on YARN-2770: --- Quick comments: - Let's

[jira] [Updated] (YARN-2778) YARN node CLI should display labels on returned node reports

2014-10-30 Thread Wangda Tan (JIRA)
Project: Hadoop YARN Issue Type: Sub-task Components: client Reporter: Wangda Tan Assignee: Wangda Tan Attachments: YARN-2778-20141030-1.patch When user run yarn node -list .., it should print labels of this node as well. Upon

[jira] [Updated] (YARN-2771) DistributedShell's DSConstants are badly named

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2771: -- Attachment: YARN-2771.3.patch Fix the test failure DistributedShell's DSConstants are badly named

[jira] [Updated] (YARN-2779) SystemMetricsPublisher can use Kerberos directly instead of timeline DT

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2779: -- Attachment: YARN-2779.1.patch Upload a patch to remove the code of getting the timeline DT in the

[jira] [Updated] (YARN-2186) Node Manager uploader service for cache manager

2014-10-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2186: -- Attachment: YARN-2186-trunk-v5.patch v.5 patch posted. It addresses all the review comments from

[jira] [Commented] (YARN-2186) Node Manager uploader service for cache manager

2014-10-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191062#comment-14191062 ] Karthik Kambatla commented on YARN-2186: Thanks Sangjin. I barely skimmed through

[jira] [Commented] (YARN-2186) Node Manager uploader service for cache manager

2014-10-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191066#comment-14191066 ] Sangjin Lee commented on YARN-2186: --- {quote} Thanks for filing the follow up JIRAs. If

[jira] [Commented] (YARN-2186) Node Manager uploader service for cache manager

2014-10-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191070#comment-14191070 ] Karthik Kambatla commented on YARN-2186: The response field of canUpload to

[jira] [Commented] (YARN-2186) Node Manager uploader service for cache manager

2014-10-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191074#comment-14191074 ] Sangjin Lee commented on YARN-2186: --- Got it. I'll update the patch shortly. Thanks!

[jira] [Commented] (YARN-2771) DistributedShell's DSConstants are badly named

2014-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191089#comment-14191089 ] Hadoop QA commented on YARN-2771: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2186) Node Manager uploader service for cache manager

2014-10-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2186: -- Attachment: YARN-2186-trunk-v6.patch v.6 patch posted. Node Manager uploader service for cache manager

[jira] [Commented] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService

2014-10-30 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12678275/YARN-2698-20141030-1.patch against trunk revision 5e3f428. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears

[jira] [Commented] (YARN-2186) Node Manager uploader service for cache manager

2014-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191105#comment-14191105 ] Hadoop QA commented on YARN-2186: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2383) Add ability to renew ClientToAMToken

2014-10-30 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191121#comment-14191121 ] Anubhav Dhoot commented on YARN-2383: - Hi [~xgong] can you please rebase the patch

[jira] [Commented] (YARN-2383) Add ability to renew ClientToAMToken

2014-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191131#comment-14191131 ] Hadoop QA commented on YARN-2383: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2186) Node Manager uploader service for cache manager

2014-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191135#comment-14191135 ] Hadoop QA commented on YARN-2186: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2779) SystemMetricsPublisher can use Kerberos directly instead of timeline DT

2014-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191144#comment-14191144 ] Hadoop QA commented on YARN-2779: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-10-30 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191173#comment-14191173 ] zhihai xu commented on YARN-2753: - Hi [~xgong], since [~leftnoteasy] agreed to my

[jira] [Commented] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191174#comment-14191174 ] Zhijie Shen commented on YARN-2770: --- bq. SecurityUtil#getServerPrincipal may be useful.

[jira] [Updated] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2770: -- Attachment: YARN-2770.2.patch Timeline delegation tokens need to be automatically renewed by the RM

[jira] [Commented] (YARN-2779) SystemMetricsPublisher can use Kerberos directly instead of timeline DT

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191177#comment-14191177 ] Zhijie Shen commented on YARN-2779: --- I've verified it in a secure cluster, and

[jira] [Commented] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

2014-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191224#comment-14191224 ] Hadoop QA commented on YARN-2770: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-2782) TestResourceTrackerOnHA fails on trunk

2014-10-30 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2782: - Summary: TestResourceTrackerOnHA fails on trunk Key: YARN-2782 URL: https://issues.apache.org/jira/browse/YARN-2782 Project: Hadoop YARN Issue Type: Test

[jira] [Created] (YARN-2783) TestApplicationClientProtocolOnHA

2014-10-30 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2783: - Summary: TestApplicationClientProtocolOnHA Key: YARN-2783 URL: https://issues.apache.org/jira/browse/YARN-2783 Project: Hadoop YARN Issue Type: Test

[jira] [Commented] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

2014-10-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191308#comment-14191308 ] Zhijie Shen commented on YARN-2770: --- The two test failures are not related, and happen on

[jira] [Commented] (YARN-2634) Test failure for TestClientRMTokens

2014-10-30 Thread Yang Yifan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191337#comment-14191337 ] Yang Yifan commented on YARN-2634: -- Face the same problem. Test failure for

[jira] [Commented] (YARN-2775) There is no close method in NMWebServices#getLogs()

2014-10-30 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191411#comment-14191411 ] Ravi Prakash commented on YARN-2775: Hi skrho! Thanks for the contribution. It seems

[jira] [Commented] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YarnClient instead of AdminService

2014-10-30 Thread Vinod Kumar Vavilapalli (JIRA)
.patch, YARN-2698-20141029-1.patch, YARN-2698-20141029-2.patch, YARN-2698-20141030-1.patch YARN AdminService should have write API only, for other read APIs, they should be located at RM ClientService. Include, 1) getClusterNodeLabels 2) getNodeToLabels 3) getNodeReport should contains