[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-10-18 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14176202#comment-14176202 ] zhihai xu commented on YARN-2701: - thanks [~xgong], I want to discuss about check_permissi

[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-10-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177477#comment-14177477 ] zhihai xu commented on YARN-2701: - Hi [~xgong], thanks for the details explanation. The exp

[jira] [Commented] (YARN-2714) Localizer thread might stuck if NM is OOM

2014-10-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177551#comment-14177551 ] zhihai xu commented on YARN-2714: - YARN-2578 will address item 2, which try to fix the RPC

[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-10-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177627#comment-14177627 ] zhihai xu commented on YARN-2701: - thanks [~xgong], the latest patch looks most good to me,

[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-10-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177655#comment-14177655 ] zhihai xu commented on YARN-2701: - thanks [~xgong], The latest patch LGTM. > Potential rac

[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-10-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14177834#comment-14177834 ] zhihai xu commented on YARN-2701: - thanks [~jianhe], The latest patch LGTM. > Potential ra

[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-10-22 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180119#comment-14180119 ] zhihai xu commented on YARN-2701: - One nit in the addendum patch: Can we change {code} if

[jira] [Commented] (YARN-2714) Localizer thread might stuck if NM is OOM

2014-10-22 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180754#comment-14180754 ] zhihai xu commented on YARN-2714: - YARN-2730 is to address 3.a. > Localizer thread might s

[jira] [Created] (YARN-2735) diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection

2014-10-23 Thread zhihai xu (JIRA)
zhihai xu created YARN-2735: --- Summary: diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection Key: YARN-2735 URL: https://issues.apache.org/jira/browse/YARN-2735

[jira] [Updated] (YARN-2735) diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection

2014-10-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2735: Attachment: YARN-2735.000.patch > diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are > initi

[jira] [Commented] (YARN-2735) diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection

2014-10-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14181764#comment-14181764 ] zhihai xu commented on YARN-2735: - I attached a patch to remove the unnecessary initializat

[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-10-24 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14183656#comment-14183656 ] zhihai xu commented on YARN-2701: - I think the warning is because we should add definition

[jira] [Created] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
zhihai xu created YARN-2753: --- Summary: potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager Key: YARN-2753 URL: https://issues.apache.org/jira/browse/YARN-2753 Project: Hadoop YARN

[jira] [Updated] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.000.patch > potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager > ---

[jira] [Created] (YARN-2754) addToCluserNodeLabels should be protected by writeLock in RMNodeLabelsManager.java.

2014-10-27 Thread zhihai xu (JIRA)
zhihai xu created YARN-2754: --- Summary: addToCluserNodeLabels should be protected by writeLock in RMNodeLabelsManager.java. Key: YARN-2754 URL: https://issues.apache.org/jira/browse/YARN-2754 Project: Hadoop

[jira] [Updated] (YARN-2754) addToCluserNodeLabels should be protected by writeLock in RMNodeLabelsManager.java.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2754: Attachment: YARN-2754.000.patch > addToCluserNodeLabels should be protected by writeLock in > RMNodeLabelsMa

[jira] [Created] (YARN-2756) use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory.

2014-10-27 Thread zhihai xu (JIRA)
zhihai xu created YARN-2756: --- Summary: use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory. Key: YARN-2756 URL: https://issues.apache.org/jira/browse/YARN-2756

[jira] [Updated] (YARN-2756) use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2756: Description: use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager

[jira] [Updated] (YARN-2756) use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2756: Attachment: YARN-2756.000.patch > use static variable (Resources.none()) for not-running Node.resource in >

[jira] [Updated] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.001.patch > potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager > ---

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186047#comment-14186047 ] zhihai xu commented on YARN-2753: - [~leftnoteasy], thanks to review the patch, I remove lab

[jira] [Created] (YARN-2757) potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels.

2014-10-27 Thread zhihai xu (JIRA)
zhihai xu created YARN-2757: --- Summary: potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels. Key: YARN-2757 URL: https://issues.apache.org/jira/browse/YARN-2757 Project: Hadoop YARN

[jira] [Updated] (YARN-2757) potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2757: Issue Type: Bug (was: Improvement) > potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLab

[jira] [Updated] (YARN-2757) potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2757: Attachment: YARN-2757.000.patch > potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels.

[jira] [Created] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset.

2014-10-27 Thread zhihai xu (JIRA)
zhihai xu created YARN-2759: --- Summary: addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset. Key: YARN-2759 URL: https://issues.apache.org/

[jira] [Updated] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2759: Attachment: YARN-2759.000.patch > addToCluserNodeLabels should not change the value in labelCollections if th

[jira] [Commented] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186177#comment-14186177 ] zhihai xu commented on YARN-2759: - In the patch, I add a test case which add label "p1" twi

[jira] [Updated] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.002.patch > potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager > ---

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186276#comment-14186276 ] zhihai xu commented on YARN-2753: - I added a unit test in new patch YARN-2753.002.patch, wi

[jira] [Updated] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2759: Attachment: YARN-2759.001.patch > addToCluserNodeLabels should not change the value in labelCollections if th

[jira] [Updated] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource is reset.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2759: Attachment: (was: YARN-2759.001.patch) > addToCluserNodeLabels should not change the value in labelCollec

[jira] [Updated] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.003.patch > potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager > ---

[jira] [Commented] (YARN-2753) potential NPE in checkRemoveLabelsFromNode of CommonNodeLabelsManager

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186421#comment-14186421 ] zhihai xu commented on YARN-2753: - Hi [~leftnoteasy], I merged the patch in YARN-2759 into

[jira] [Updated] (YARN-2753) Shouldn't change the value in labelCollections if the key already exists and potential NPE at CommonNodeLabelsManager.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Description: CommonNodeLabelsManager#addToCluserNodeLabels should not change the value in labelCollections i

[jira] [Updated] (YARN-2753) Shouldn't change the value in labelCollections if the key already exists and potential NPE at CommonNodeLabelsManager.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Description: CommonNodeLabelsManager#addToCluserNodeLabels should not change the value in labelCollections i

[jira] [Updated] (YARN-2759) addToCluserNodeLabels should not change the value in labelCollections if the key already exists to avoid the Label.resource being reset.

2014-10-27 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2759: Description: addToCluserNodeLabels should not change the value in labelCollections if the key already exists

[jira] [Updated] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-10-28 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.004.patch > Fix potential issues and code clean up for *NodeLabelsManager > ---

[jira] [Updated] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-10-28 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Description: Issues include: * CommonNodeLabelsManager#addToCluserNodeLabels should not change the value in

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-10-28 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187575#comment-14187575 ] zhihai xu commented on YARN-2753: - Hi [~leftnoteasy], thanks for your suggestion. I also me

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-10-28 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187579#comment-14187579 ] zhihai xu commented on YARN-2753: - The new patch YARN-2753.004.patch will include 4 patches

[jira] [Reopened] (YARN-2756) use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory.

2014-10-28 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu reopened YARN-2756: - > use static variable (Resources.none()) for not-running Node.resource in > CommonNodeLabelsManager to save me

[jira] [Commented] (YARN-2756) use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory.

2014-10-28 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187595#comment-14187595 ] zhihai xu commented on YARN-2756: - Separate this JIRA from YARN-2753 for discussion. > use

[jira] [Updated] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-10-28 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Description: Issues include: * CommonNodeLabelsManager#addToCluserNodeLabels should not change the value in

[jira] [Updated] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-10-28 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.005.patch > Fix potential issues and code clean up for *NodeLabelsManager > ---

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-10-28 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187619#comment-14187619 ] zhihai xu commented on YARN-2753: - I remove YARN-2756 from this JIRA YARN-2753, so we can d

[jira] [Commented] (YARN-2756) use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory.

2014-10-28 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187660#comment-14187660 ] zhihai xu commented on YARN-2756: - Hi [~leftnoteasy] bq. but you cannot say in the future,

[jira] [Commented] (YARN-2757) potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels.

2014-10-28 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14187672#comment-14187672 ] zhihai xu commented on YARN-2757: - Hi [~leftnoteasy], thanks to review the patch. I agree

[jira] [Updated] (YARN-2757) potential NPE in checkNodeLabelExpression of SchedulerUtils for nodeLabels.

2014-10-28 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2757: Issue Type: Sub-task (was: Bug) Parent: YARN-2492 > potential NPE in checkNodeLabelExpression of Sch

[jira] [Updated] (YARN-2756) use static variable (Resources.none()) for not-running Node.resource in CommonNodeLabelsManager to save memory.

2014-10-28 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2756: Issue Type: Sub-task (was: Improvement) Parent: YARN-2492 > use static variable (Resources.none()) f

[jira] [Updated] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-10-29 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: (was: YARN-2753.005.patch) > Fix potential issues and code clean up for *NodeLabelsManager >

[jira] [Updated] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-10-29 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.005.patch > Fix potential issues and code clean up for *NodeLabelsManager > ---

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-10-30 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14191173#comment-14191173 ] zhihai xu commented on YARN-2753: - Hi [~xgong], since [~leftnoteasy] agreed to my patch(YAR

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-10-31 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14192724#comment-14192724 ] zhihai xu commented on YARN-2753: - Hi [~leftnoteasy], thanks to review the patch. zhihai >

[jira] [Created] (YARN-2799) cleanup TestLogAggregationService based on the change in YARN-90

2014-11-02 Thread zhihai xu (JIRA)
zhihai xu created YARN-2799: --- Summary: cleanup TestLogAggregationService based on the change in YARN-90 Key: YARN-2799 URL: https://issues.apache.org/jira/browse/YARN-2799 Project: Hadoop YARN Iss

[jira] [Updated] (YARN-2799) cleanup TestLogAggregationService based on the change in YARN-90

2014-11-02 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2799: Attachment: YARN-2799.000.patch > cleanup TestLogAggregationService based on the change in YARN-90 >

[jira] [Assigned] (YARN-2799) cleanup TestLogAggregationService based on the change in YARN-90

2014-11-02 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu reassigned YARN-2799: --- Assignee: zhihai xu > cleanup TestLogAggregationService based on the change in YARN-90 > -

[jira] [Created] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-03 Thread zhihai xu (JIRA)
zhihai xu created YARN-2802: --- Summary: add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue. Key: YARN-2802 URL: https://issues.apache.org/jira/browse/YARN-2802

[jira] [Updated] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2802: Attachment: YARN-2802.000.patch > add AM container launch and register delay metrics in QueueMetrics to help

[jira] [Updated] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2802: Attachment: YARN-2802.000.patch > add AM container launch and register delay metrics in QueueMetrics to help

[jira] [Updated] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2802: Attachment: (was: YARN-2802.000.patch) > add AM container launch and register delay metrics in QueueMetri

[jira] [Commented] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195420#comment-14195420 ] zhihai xu commented on YARN-2802: - The TestRMProxyUsersConf is passed in my local build: -

[jira] [Updated] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2802: Attachment: (was: YARN-2802.000.patch) > add AM container launch and register delay metrics in QueueMetri

[jira] [Updated] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2802: Attachment: YARN-2802.000.patch > add AM container launch and register delay metrics in QueueMetrics to help

[jira] [Updated] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2802: Attachment: YARN-2802.001.patch > add AM container launch and register delay metrics in QueueMetrics to help

[jira] [Commented] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195746#comment-14195746 ] zhihai xu commented on YARN-2802: - attached the patch YARN-2802.001.patch to fix the test e

[jira] [Updated] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-03 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2802: Issue Type: Improvement (was: Bug) > add AM container launch and register delay metrics in QueueMetrics to h

[jira] [Created] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-05 Thread zhihai xu (JIRA)
zhihai xu created YARN-2816: --- Summary: NM fail to start with NPE during container recovery Key: YARN-2816 URL: https://issues.apache.org/jira/browse/YARN-2816 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-05 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2816: Attachment: YARN-2816.000.patch > NM fail to start with NPE during container recovery > -

[jira] [Commented] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-05 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199615#comment-14199615 ] zhihai xu commented on YARN-2816: - I submitted a patch to review. The fix is to delete all

[jira] [Commented] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-05 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199866#comment-14199866 ] zhihai xu commented on YARN-2816: - [levelDB document|http://docs.basho.com/riak/latest/ops

[jira] [Updated] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-05 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2816: Priority: Critical (was: Major) > NM fail to start with NPE during container recovery >

[jira] [Commented] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-05 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14199950#comment-14199950 ] zhihai xu commented on YARN-2802: - Hi [~vinodkv], thanks to review the patch. I looked at

[jira] [Updated] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.006.patch > Fix potential issues and code clean up for *NodeLabelsManager > ---

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1427#comment-1427 ] zhihai xu commented on YARN-2753: - Hi [~leftnoteasy], thanks for the thorough review. item

[jira] [Created] (YARN-2820) Improve FileSystemRMStateStore update failure exception handling to not shutdown RM.

2014-11-06 Thread zhihai xu (JIRA)
zhihai xu created YARN-2820: --- Summary: Improve FileSystemRMStateStore update failure exception handling to not shutdown RM. Key: YARN-2820 URL: https://issues.apache.org/jira/browse/YARN-2820 Project: Hado

[jira] [Commented] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201020#comment-14201020 ] zhihai xu commented on YARN-2816: - Hi [~jlowe], thanks for the review, Based on your commen

[jira] [Updated] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2816: Attachment: leveldb_records.txt > NM fail to start with NPE during container recovery > -

[jira] [Updated] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2816: Priority: Major (was: Critical) > NM fail to start with NPE during container recovery >

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-06 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201038#comment-14201038 ] zhihai xu commented on YARN-2753: - Hi [~xgong], Could you help review and commit the patch

[jira] [Updated] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-07 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.007.patch > Fix potential issues and code clean up for *NodeLabelsManager > ---

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-07 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201795#comment-14201795 ] zhihai xu commented on YARN-2753: - Cool, good catch. addressed your comment in the new patc

[jira] [Updated] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-07 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2753: Attachment: YARN-2753.008.patch > Fix potential issues and code clean up for *NodeLabelsManager > ---

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-07 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14202491#comment-14202491 ] zhihai xu commented on YARN-2753: - Hi [~leftnoteasy], Good finding, addressed your comment

[jira] [Commented] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-07 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14202595#comment-14202595 ] zhihai xu commented on YARN-2816: - Hi [~jlowe], thanks for the review. Sorry I misundersta

[jira] [Updated] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-07 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2816: Attachment: YARN-2816.001.patch > NM fail to start with NPE during container recovery > -

[jira] [Created] (YARN-2831) NM should kill and cleanup the leaked containers.

2014-11-07 Thread zhihai xu (JIRA)
zhihai xu created YARN-2831: --- Summary: NM should kill and cleanup the leaked containers. Key: YARN-2831 URL: https://issues.apache.org/jira/browse/YARN-2831 Project: Hadoop YARN Issue Type: Bug

[jira] [Assigned] (YARN-2831) NM should kill and cleanup the leaked containers.

2014-11-07 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu reassigned YARN-2831: --- Assignee: zhihai xu > NM should kill and cleanup the leaked containers. >

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-07 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14202729#comment-14202729 ] zhihai xu commented on YARN-2753: - The two test failures are not related to my patch. All t

[jira] [Commented] (YARN-2753) Fix potential issues and code clean up for *NodeLabelsManager

2014-11-07 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14202847#comment-14202847 ] zhihai xu commented on YARN-2753: - thanks [~vinodkv] for the thorough review and commit, th

[jira] [Updated] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2816: Attachment: YARN-2816.002.patch > NM fail to start with NPE during container recovery > -

[jira] [Commented] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209201#comment-14209201 ] zhihai xu commented on YARN-2816: - Attached a new patch ../YARN-2816.002.patch to fix java

[jira] [Updated] (YARN-2799) cleanup TestLogAggregationService based on the change in YARN-90

2014-11-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2799: Attachment: YARN-2799.001.patch > cleanup TestLogAggregationService based on the change in YARN-90 >

[jira] [Commented] (YARN-2799) cleanup TestLogAggregationService based on the change in YARN-90

2014-11-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209222#comment-14209222 ] zhihai xu commented on YARN-2799: - attached a new patch YARN-2799.001.patch which is rebase

[jira] [Updated] (YARN-2315) Should use setCurrentCapacity instead of setCapacity to configure used resource capacity for FairScheduler.

2014-11-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2315: Attachment: YARN-2315.003.patch > Should use setCurrentCapacity instead of setCapacity to configure used > r

[jira] [Commented] (YARN-2816) NM fail to start with NPE during container recovery

2014-11-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209283#comment-14209283 ] zhihai xu commented on YARN-2816: - Hi [~jlowe], Are you ok with the new patch? thanks zhi

[jira] [Updated] (YARN-2675) the containersKilled metrics is not updated when the container is killed during localization.

2014-11-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2675: Attachment: YARN-2675.001.patch > the containersKilled metrics is not updated when the container is killed >

[jira] [Updated] (YARN-2679) add container launch prepare time metrics to NM.

2014-11-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2679: Issue Type: Improvement (was: Bug) > add container launch prepare time metrics to NM. >

[jira] [Updated] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2802: Attachment: YARN-2802.002.patch > add AM container launch and register delay metrics in QueueMetrics to help

[jira] [Commented] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-12 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14209401#comment-14209401 ] zhihai xu commented on YARN-2802: - Attached a new patch YARN-2802.002.patch to rebase to la

[jira] [Commented] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-14 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14212992#comment-14212992 ] zhihai xu commented on YARN-2802: - Hi [~jianhe] and [~vinodkv], Could you review the patch

<    4   5   6   7   8   9   10   11   12   >