[jira] [Commented] (YARN-2669) FairScheduler: queueName shouldn't allow periods the allocation.xml

2014-10-27 Thread bc Wong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186448#comment-14186448 ] bc Wong commented on YARN-2669: --- Replacing "." with "\_dot\_" sounds fine here. While it does

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2014-10-27 Thread Janos Matyas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186446#comment-14186446 ] Janos Matyas commented on YARN-1964: Hi Abin, I have applied the changes to the image

[jira] [Updated] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource being reset.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2759: Description: addToCluserNodeLabels should not change the value in labelCollections if the key already exists

[jira] [Updated] (YARN-2753) Shouldn't change the value in labelCollections if the key already exists and potential NPE at CommonNodeLabelsManager.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Description: CommonNodeLabelsManager#addToCluserNodeLabels should not change the value in labelCollections i

[jira] [Updated] (YARN-2753) Shouldn't change the value in labelCollections if the key already exists and potential NPE at CommonNodeLabelsManager.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Description: CommonNodeLabelsManager#addToCluserNodeLabels should not change the value in labelCollections i

[jira] [Commented] (YARN-1813) Better error message for "yarn logs" when permission denied

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186428#comment-14186428 ] Hadoop QA commented on YARN-1813: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186421#comment-14186421 ] zhihai xu commented on YARN-2753: - Hi [~leftnoteasy], I merged the patch in YARN-2759 into

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186411#comment-14186411 ] Hadoop QA commented on YARN-2753: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.003.patch > potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager > ---

[jira] [Updated] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2759: Attachment: (was: YARN-2759.001.patch) > addToCluserNodeLabels should not change the value in labelCollec

[jira] [Updated] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2759: Attachment: YARN-2759.001.patch > addToCluserNodeLabels should not change the value in labelCollections if th

[jira] [Commented] (YARN-2725) Adding test cases of retrying requests about ZKRMStateStore

2014-10-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186402#comment-14186402 ] Tsuyoshi OZAWA commented on YARN-2725: -- [~jianhe], do you mind taking a look? > Addin

[jira] [Commented] (YARN-2737) Misleading msg in LogCLI when app is not successfully submitted

2014-10-27 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186366#comment-14186366 ] Rohith commented on YARN-2737: -- One way is print all possible reasons that can cause this issu

[jira] [Created] (YARN-2762) Provide RMAdminCLI args validation for NodeLabelManager operations

2014-10-27 Thread Rohith (JIRA)
Rohith created YARN-2762: Summary: Provide RMAdminCLI args validation for NodeLabelManager operations Key: YARN-2762 URL: https://issues.apache.org/jira/browse/YARN-2762 Project: Hadoop YARN Issue T

[jira] [Commented] (YARN-2760) Completely remove word 'experimental' from FairScheduler docs

2014-10-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186328#comment-14186328 ] Zhijie Shen commented on YARN-2760: --- We should have run into the same issue: HADOOP-11240

[jira] [Commented] (YARN-2760) Completely remove word 'experimental' from FairScheduler docs

2014-10-27 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186325#comment-14186325 ] Harsh J commented on YARN-2760: --- Patch can certainly be applied. Script or build box is havin

[jira] [Created] (YARN-2761) potential race condition in SchedulingPolicy

2014-10-27 Thread Hong Zhiguo (JIRA)
Hong Zhiguo created YARN-2761: - Summary: potential race condition in SchedulingPolicy Key: YARN-2761 URL: https://issues.apache.org/jira/browse/YARN-2761 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-2502) Changes in distributed shell to support specify labels

2014-10-27 Thread Hudson (JIRA)
Issue Type: Sub-task > Components: resourcemanager >Reporter: Wangda Tan >Assignee: Wangda Tan > Attachments: YARN-2502-20141009.1.patch, YARN-2502-20141009.2.patch, > YARN-2502-20141013.1.patch, YARN-2502-20141017-1.patch, > YARN-2502-2

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186279#comment-14186279 ] Hadoop QA commented on YARN-2753: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Assigned] (YARN-2737) Misleading msg in LogCLI when app is not successfully submitted

2014-10-27 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-2737: Assignee: Rohith > Misleading msg in LogCLI when app is not successfully submitted > --

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186276#comment-14186276 ] zhihai xu commented on YARN-2753: - I added a unit test in new patch YARN-2753.002.patch, wi

[jira] [Updated] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.002.patch > potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager > ---

[jira] [Commented] (YARN-2760) Completely remove word 'experimental' from FairScheduler docs

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186275#comment-14186275 ] Hadoop QA commented on YARN-2760: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2502) Changes in distributed shell to support specify labels

2014-10-27 Thread Jian He (JIRA)
Components: resourcemanager >Reporter: Wangda Tan >Assignee: Wangda Tan > Attachments: YARN-2502-20141009.1.patch, YARN-2502-20141009.2.patch, > YARN-2502-20141013.1.patch, YARN-2502-20141017-1.patch, > YARN-2502-20141017-2.patch, YARN-2502-20141027-2.patch, YARN-250

[jira] [Updated] (YARN-2760) Completely remove word 'experimental' from FairScheduler docs

2014-10-27 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated YARN-2760: -- Attachment: YARN-2760.patch > Completely remove word 'experimental' from FairScheduler docs > ---

[jira] [Created] (YARN-2760) Completely remove word 'experimental' from FairScheduler docs

2014-10-27 Thread Harsh J (JIRA)
Harsh J created YARN-2760: - Summary: Completely remove word 'experimental' from FairScheduler docs Key: YARN-2760 URL: https://issues.apache.org/jira/browse/YARN-2760 Project: Hadoop YARN Issue Type

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2014-10-27 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186253#comment-14186253 ] Abin Shahab commented on YARN-1964: --- Sid, thanks for looking at it. The docker image is s

[jira] [Commented] (YARN-2755) NM fails to clean up usercache_DEL_ dirs after YARN-661

2014-10-27 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186238#comment-14186238 ] Sangjin Lee commented on YARN-2755: --- Thanks [~l201514]. Just wanted to add that when this

[jira] [Commented] (YARN-2756) use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory.

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186236#comment-14186236 ] Hadoop QA commented on YARN-2756: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2758) Update TestApplicationHistoryClientService to use the new generic history store

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186229#comment-14186229 ] Hadoop QA commented on YARN-2758: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2758) Update TestApplicationHistoryClientService to use the new generic history store

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186226#comment-14186226 ] Hadoop QA commented on YARN-2758: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2758) Update TestApplicationHistoryClientService to use the new generic history store

2014-10-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2758: -- Attachment: YARN-2758.1.patch Hook the test cases to the new generic history store on top of the timeline

[jira] [Commented] (YARN-2757) potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels.

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186207#comment-14186207 ] Hadoop QA commented on YARN-2757: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset.

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186203#comment-14186203 ] Wangda Tan commented on YARN-2759: -- Hi [~zxu], Thanks for raising these issues and upload

[jira] [Commented] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset.

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186188#comment-14186188 ] Hadoop QA commented on YARN-2759: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186177#comment-14186177 ] zhihai xu commented on YARN-2759: - In the patch, I add a test case which add label "p1" twi

[jira] [Commented] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-10-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186176#comment-14186176 ] Jian He commented on YARN-2010: --- bq. Any subsequent attempts to transition the RM to active f

[jira] [Updated] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2759: Attachment: YARN-2759.000.patch > addToCluserNodeLabels should not change the value in labelCollections if th

[jira] [Created] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset.

2014-10-27 Thread zhihai xu (JIRA)
zhihai xu created YARN-2759: --- Summary: addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset. Key: YARN-2759 URL: https://issues.apache.org/

[jira] [Commented] (YARN-2749) Some testcases from TestLogAggregationService fails in trunk

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186139#comment-14186139 ] Hadoop QA commented on YARN-2749: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2014-10-27 Thread sidharta seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186126#comment-14186126 ] sidharta seethana commented on YARN-1964: - Hi Abin, I applied the patch to a recen

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186125#comment-14186125 ] Hadoop QA commented on YARN-2753: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (YARN-2758) Update TestApplicationHistoryClientService to use the new generic history store

2014-10-27 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2758: - Summary: Update TestApplicationHistoryClientService to use the new generic history store Key: YARN-2758 URL: https://issues.apache.org/jira/browse/YARN-2758 Project: Hadoop

[jira] [Updated] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YARN CLI instead of RMAdminCLI

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2698: - Priority: Critical (was: Major) > Move getClusterNodeLabels and getNodeToLabels to YARN CLI instead of >

[jira] [Updated] (YARN-2698) Move getClusterNodeLabels and getNodeToLabels to YARN CLI instead of RMAdminCLI

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2698: - Target Version/s: 2.6.0 > Move getClusterNodeLabels and getNodeToLabels to YARN CLI instead of > RMAdminCL

[jira] [Commented] (YARN-2755) NM fails to clean up usercache_DEL_ dirs after YARN-661

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186115#comment-14186115 ] Hadoop QA commented on YARN-2755: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2757) potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2757: Attachment: YARN-2757.000.patch > potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels.

[jira] [Updated] (YARN-2757) potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2757: Issue Type: Bug (was: Improvement) > potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLab

[jira] [Created] (YARN-2757) potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels.

2014-10-27 Thread zhihai xu (JIRA)
zhihai xu created YARN-2757: --- Summary: potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels. Key: YARN-2757 URL: https://issues.apache.org/jira/browse/YARN-2757 Project: Hadoop YARN

[jira] [Commented] (YARN-2755) NM fails to clean up usercache_DEL_ dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186105#comment-14186105 ] Siqi Li commented on YARN-2755: --- When NM starts up, it moves usercache to usercache_DEL_, and

[jira] [Commented] (YARN-2741) Windows: Node manager cannot serve up log files via the web user interface when yarn.nodemanager.log-dirs to any drive letter other than C: (or, the drive that nodemanag

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186094#comment-14186094 ] Hadoop QA commented on YARN-2741: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2755) NM fails to clean up usercache_DEL_ dirs after YARN-661

2014-10-27 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186079#comment-14186079 ] Sangjin Lee commented on YARN-2755: --- @siqi, it would be good to elaborate on the nature o

[jira] [Updated] (YARN-2749) Some testcases from TestLogAggregationService fails in trunk

2014-10-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2749: Attachment: YARN-2749.1.patch > Some testcases from TestLogAggregationService fails in trunk > --

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186047#comment-14186047 ] zhihai xu commented on YARN-2753: - [~leftnoteasy], thanks to review the patch, I remove lab

[jira] [Commented] (YARN-2754) addToCluserNodeLabels should be protected by writeLock in RMNodeLabelsManager.java.

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186049#comment-14186049 ] Hadoop QA commented on YARN-2754: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2755) NM fails to clean up usercache_DEL_ dirs after YARN-661

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186048#comment-14186048 ] Hadoop QA commented on YARN-2755: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.001.patch > potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager > ---

[jira] [Updated] (YARN-2755) NM fails to clean up usercache_DEL_ dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2755: -- Attachment: YARN-2755.v1.patch > NM fails to clean up usercache_DEL_ dirs after YARN-661 > --

[jira] [Updated] (YARN-2755) NM fails to clean up usercache_DEL_ dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2755: -- Attachment: (was: YARN-2755.v1.patch) > NM fails to clean up usercache_DEL_ dirs after YARN-661 > ---

[jira] [Commented] (YARN-2502) Changes in distributed shell to support specify labels

2014-10-27 Thread Hadoop QA (JIRA)
ults of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12677419/YARN-2502-20141027-2.patch against trunk revision a16d022. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The p

[jira] [Updated] (YARN-2741) Windows: Node manager cannot serve up log files via the web user interface when yarn.nodemanager.log-dirs to any drive letter other than C: (or, the drive that nodemanager

2014-10-27 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2741: -- Attachment: YARN-2741.6.patch Added unit tests > Windows: Node manager cannot serve up log files via the

[jira] [Updated] (YARN-2756) use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2756: Attachment: YARN-2756.000.patch > use static variable (Resources.none()) for not-running Node.resource in >

[jira] [Updated] (YARN-2756) use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2756: Description: use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager

[jira] [Created] (YARN-2756) use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory.

2014-10-27 Thread zhihai xu (JIRA)
zhihai xu created YARN-2756: --- Summary: use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory. Key: YARN-2756 URL: https://issues.apache.org/jira/browse/YARN-2756

[jira] [Commented] (YARN-2754) addToCluserNodeLabels should be protected by writeLock in RMNodeLabelsManager.java.

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185982#comment-14185982 ] Wangda Tan commented on YARN-2754: -- Zhihai, Thanks reporting and the fix, Patch LGTM +1,

[jira] [Updated] (YARN-2754) addToCluserNodeLabels should be protected by writeLock in RMNodeLabelsManager.java.

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2754: - Issue Type: Sub-task (was: Bug) Parent: YARN-2492 > addToCluserNodeLabels should be protected by w

[jira] [Updated] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2753: - Issue Type: Sub-task (was: Bug) Parent: YARN-2492 > potential NPE in checkRemoveLabelsFromNode of

[jira] [Updated] (YARN-2755) NM fails to clean up usercache_DEL_ dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2755: -- Attachment: YARN-2755.v1.patch > NM fails to clean up usercache_DEL_ dirs after YARN-661 > --

[jira] [Updated] (YARN-2755) NM fails to clean up usercache_DEL_ dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2755: -- Priority: Critical (was: Major) > NM fails to clean up usercache_DEL_ dirs after YARN-661 >

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185977#comment-14185977 ] Wangda Tan commented on YARN-2753: -- [~zxu], Nice finding! Thanks for the patch, looks good

[jira] [Commented] (YARN-2704) Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time

2014-10-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185963#comment-14185963 ] Hudson commented on YARN-2704: -- FAILURE: Integrated in Hadoop-trunk-Commit #6357 (See [https:

[jira] [Updated] (YARN-2704) Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time

2014-10-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2704: -- Priority: Critical (was: Major) This is critical for long running services. Gett

[jira] [Commented] (YARN-2704) Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time

2014-10-27 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185954#comment-14185954 ] Vinod Kumar Vavilapalli commented on YARN-2704: --- +1, looks good. Checking thi

[jira] [Commented] (YARN-2755) NM fails to clean up usercache_DEL_ dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185948#comment-14185948 ] Siqi Li commented on YARN-2755: --- [~sjlee0] mentioned that "NM's initialization is taking a LO

[jira] [Updated] (YARN-2755) NM fails to clean up usercache_DEL_ dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2755: -- Description: When NM restarts frequently due to some reason, a large number of directories like these left in /d

[jira] [Assigned] (YARN-2755) NM fails to clean up usercache_DEL_ dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li reassigned YARN-2755: - Assignee: Siqi Li > NM fails to clean up usercache_DEL_ dirs after YARN-661 >

[jira] [Created] (YARN-2755) NM fails to clean up usercache_DEL_ dirs after YARN-661

2014-10-27 Thread Siqi Li (JIRA)
Siqi Li created YARN-2755: - Summary: NM fails to clean up usercache_DEL_ dirs after YARN-661 Key: YARN-2755 URL: https://issues.apache.org/jira/browse/YARN-2755 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185931#comment-14185931 ] Hadoop QA commented on YARN-2753: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2502) Changes in distributed shell to support specify labels

2014-10-27 Thread Hadoop QA (JIRA)
s of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12677419/YARN-2502-20141027-2.patch against trunk revision 5b1dfe7. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch app

[jira] [Updated] (YARN-2754) addToCluserNodeLabels should be protected by writeLock in RMNodeLabelsManager.java.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2754: Attachment: YARN-2754.000.patch > addToCluserNodeLabels should be protected by writeLock in > RMNodeLabelsMa

[jira] [Created] (YARN-2754) addToCluserNodeLabels should be protected by writeLock in RMNodeLabelsManager.java.

2014-10-27 Thread zhihai xu (JIRA)
zhihai xu created YARN-2754: --- Summary: addToCluserNodeLabels should be protected by writeLock in RMNodeLabelsManager.java. Key: YARN-2754 URL: https://issues.apache.org/jira/browse/YARN-2754 Project: Hadoop

[jira] [Commented] (YARN-2749) Some testcases from TestLogAggregationService fails in trunk

2014-10-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185924#comment-14185924 ] Xuan Gong commented on YARN-2749: - This is because of race condition and it is the testcase

[jira] [Commented] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-10-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185883#comment-14185883 ] Jian He commented on YARN-2010: --- sorry, was caught up with something. I'll review today. >

[jira] [Updated] (YARN-2502) Changes in distributed shell to support specify labels

2014-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2502: - Attachment: YARN-2502-20141027-2.patch > Changes in distributed shell to support specify lab

[jira] [Updated] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.000.patch > potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager > ---

[jira] [Created] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
zhihai xu created YARN-2753: --- Summary: potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager Key: YARN-2753 URL: https://issues.apache.org/jira/browse/YARN-2753 Project: Hadoop YARN

[jira] [Commented] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-10-27 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185845#comment-14185845 ] Karthik Kambatla commented on YARN-2010: [~vinodkv], [~jlowe], [~jianhe] - will any

[jira] [Commented] (YARN-2669) FairScheduler: queueName shouldn't allow periods the allocation.xml

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185813#comment-14185813 ] Hadoop QA commented on YARN-2669: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2752) TestContainerExecutor.testRunCommandNoPriority fails in branch-2

2014-10-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185732#comment-14185732 ] Xuan Gong commented on YARN-2752: - Initially, The function ContainerExecutor.getRunCommand

[jira] [Commented] (YARN-2683) registry config options: document and move to core-default

2014-10-27 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185730#comment-14185730 ] Gour Saha commented on YARN-2683: - Steve, It looks great, just one minor thing - Orig: It

[jira] [Commented] (YARN-2704) Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185686#comment-14185686 ] Hadoop QA commented on YARN-2704: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2745) YARN new pluggable scheduler which does multi-resource packing

2014-10-27 Thread Robert Grandl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Grandl updated YARN-2745: Attachment: (was: tetris_design_doc.docx) > YARN new pluggable scheduler which does multi-resourc

[jira] [Updated] (YARN-2669) FairScheduler: queueName shouldn't allow periods the allocation.xml

2014-10-27 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2669: -- Attachment: YARN-2669-3.patch Thanks for the comments, [~bcwalrus]. How about replace the "." with "_dot_"? > Fa

[jira] [Updated] (YARN-2752) TestContainerExecutor.testRunCommandNoPriority fails in branch-2

2014-10-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2752: Attachment: YARN-2752.1-branch-2.patch > TestContainerExecutor.testRunCommandNoPriority fails in branch-2 > -

[jira] [Updated] (YARN-2752) TestContainerExecutor.testRunCommandNoPriority fails in branch-2

2014-10-27 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2752: Description: TestContainerExecutor.testRunCommandNoPriority fails in branch-2. But it passed in trunk. The

[jira] [Created] (YARN-2752) TestContainerExecutor.testRunCommandNoPriority fails in branch-2

2014-10-27 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-2752: --- Summary: TestContainerExecutor.testRunCommandNoPriority fails in branch-2 Key: YARN-2752 URL: https://issues.apache.org/jira/browse/YARN-2752 Project: Hadoop YARN Iss

[jira] [Commented] (YARN-2678) Recommended improvements to Yarn Registry

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185637#comment-14185637 ] Hadoop QA commented on YARN-2678: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2741) Windows: Node manager cannot serve up log files via the web user interface when yarn.nodemanager.log-dirs to any drive letter other than C: (or, the drive that nodemanag

2014-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185636#comment-14185636 ] Hadoop QA commented on YARN-2741: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2678) Recommended improvements to Yarn Registry

2014-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2678: - Attachment: YARN-2678-007.patch patch 007: upgrade "use a URI in the api" from a SHOULD to a MUST;

[jira] [Updated] (YARN-2571) RM to support YARN registry

2014-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2571: - Attachment: (was: YARN-2571-006.patch) > RM to support YARN registry > ---

  1   2   >