[jira] [Commented] (YARN-3424) Reduce log for ContainerMonitorImpl resoure monitoring from info to debug

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390052#comment-14390052 ] Hadoop QA commented on YARN-3424: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2015-04-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390076#comment-14390076 ] Arun Suresh commented on YARN-2962: --- .. alternative to starting the index from the front.

[jira] [Commented] (YARN-3429) TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390156#comment-14390156 ] Hadoop QA commented on YARN-3429: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-3424: - Summary: Change logs for ContainerMonitorImpl's resourse monitoring from info to debug (was:

[jira] [Updated] (YARN-3429) TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken

2015-04-01 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3429: Attachment: YARN-3429.000.patch TestAMRMTokens.testTokenExpiry fails Intermittently with error

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390128#comment-14390128 ] Rohith commented on YARN-3410: -- Just like YARN-2131 is handled , I think there is choice

[jira] [Updated] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-3424: - Affects Version/s: 2.7.0 Change logs for ContainerMonitorImpl's resourse monitoring from info to

[jira] [Updated] (YARN-2624) Resource Localization fails on a cluster due to existing cache directories

2015-04-01 Thread vishal.rajan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vishal.rajan updated YARN-2624: --- Target Version/s: (was: 2.6.0) Affects Version/s: 2.6.0 Resource Localization fails on a

[jira] [Commented] (YARN-2624) Resource Localization fails on a cluster due to existing cache directories

2015-04-01 Thread vishal.rajan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390319#comment-14390319 ] vishal.rajan commented on YARN-2624: please verify and reopen the jira Resource

[jira] [Updated] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-3424: - Issue Type: Improvement (was: Bug) Change logs for ContainerMonitorImpl's resourse monitoring

[jira] [Updated] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-04-01 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-3225: Attachment: YARN-3225-3.patch New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

[jira] [Commented] (YARN-2624) Resource Localization fails on a cluster due to existing cache directories

2015-04-01 Thread vishal.rajan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390305#comment-14390305 ] vishal.rajan commented on YARN-2624: seems like this issue still persist in yarn 2.6.0

[jira] [Commented] (YARN-3261) rewrite resourcemanager restart doc to remove roadmap bits

2015-04-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390258#comment-14390258 ] Rohith commented on YARN-3261: -- Thanks [~gururaj] for the patch.. +1(non-binding) for the

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390243#comment-14390243 ] Hudson commented on YARN-3424: -- FAILURE: Integrated in Hadoop-trunk-Commit #7482 (See

[jira] [Updated] (YARN-3286) Cleanup RMNode#ReconnectNodeTransition

2015-04-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3286: - Attachment: 0001-YARN-3286.patch Cleanup RMNode#ReconnectNodeTransition --

[jira] [Assigned] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-3430: --- Assignee: Xuan Gong RMAppAttempt headroom data is missing in RM Web UI

[jira] [Updated] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3430: Attachment: YARN-3430.1.patch trivial patch without testcase RMAppAttempt headroom data is missing in RM

[jira] [Updated] (YARN-3286) Cleanup RMNode#ReconnectNodeTransition

2015-04-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3286: - Description: RMNode#ReconnectNodeTransition has messed up for every ReconnectedEvent. This part of the code

[jira] [Updated] (YARN-3416) deadlock in a job between map and reduce cores allocation

2015-04-01 Thread mai shurong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mai shurong updated YARN-3416: -- Attachment: queue_with_max333cores.png queue_with_max263cores.png

[jira] [Commented] (YARN-3416) deadlock in a job between map and reduce cores allocation

2015-04-01 Thread mai shurong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390466#comment-14390466 ] mai shurong commented on YARN-3416: --- I found a new case today. I submitted a more larger

[jira] [Created] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-3430: --- Summary: RMAppAttempt headroom data is missing in RM Web UI Key: YARN-3430 URL: https://issues.apache.org/jira/browse/YARN-3430 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2015-04-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390074#comment-14390074 ] Arun Suresh commented on YARN-2962: --- Yup.. agreed, star index from the end is a better

[jira] [Commented] (YARN-2268) Disallow formatting the RMStateStore when there is an RM running

2015-04-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390122#comment-14390122 ] Rohith commented on YARN-2268: -- Thinking on this jira, getting many questions. # How to

[jira] [Commented] (YARN-3424) Reduce log for ContainerMonitorImpl resoure monitoring from info to debug

2015-04-01 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390226#comment-14390226 ] Tsuyoshi Ozawa commented on YARN-3424: -- +1 with minor indentation fix on my local.

[jira] [Commented] (YARN-3405) FairScheduler's preemption cannot happen between sibling in some case

2015-04-01 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390471#comment-14390471 ] Peng Zhang commented on YARN-3405: -- bq. 2. if parent's usage reached its fair share, it

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390407#comment-14390407 ] Xuan Gong commented on YARN-3248: - +1 lgtm. Will commit Display count of nodes

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390442#comment-14390442 ] Hudson commented on YARN-3424: -- FAILURE: Integrated in Hadoop-Yarn-trunk #884 (See

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390436#comment-14390436 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Yarn-trunk #884 (See

[jira] [Commented] (YARN-3412) RM tests should use MockRM where possible

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390443#comment-14390443 ] Hudson commented on YARN-3412: -- FAILURE: Integrated in Hadoop-Yarn-trunk #884 (See

[jira] [Updated] (YARN-3416) deadlock in a job between map and reduce cores allocation

2015-04-01 Thread mai shurong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mai shurong updated YARN-3416: -- Attachment: AM_log_head10.txt.gz AM_log_tail10.txt.gz head 10 lines and tail

[jira] [Updated] (YARN-3301) Fix the format issue of the new RM web UI and AHS web UI

2015-04-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3301: Target Version/s: 2.8.0 Fix the format issue of the new RM web UI and AHS web UI

[jira] [Commented] (YARN-3412) RM tests should use MockRM where possible

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390431#comment-14390431 ] Hudson commented on YARN-3412: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #150 (See

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390424#comment-14390424 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #150 (See

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390430#comment-14390430 ] Hudson commented on YARN-3424: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #150 (See

[jira] [Commented] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390379#comment-14390379 ] Hadoop QA commented on YARN-3225: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390412#comment-14390412 ] Xuan Gong commented on YARN-3248: - Committed into trunk/branch-2 Display count of nodes

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390422#comment-14390422 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-trunk-Commit #7483 (See

[jira] [Commented] (YARN-3428) Debug log resources to be localized for a container

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390428#comment-14390428 ] Hudson commented on YARN-3428: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #150 (See

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390452#comment-14390452 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-trunk-Commit #7484 (See

[jira] [Commented] (YARN-3405) FairScheduler's preemption cannot happen between sibling in some case

2015-04-01 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390455#comment-14390455 ] Peng Zhang commented on YARN-3405: -- I've a primitive idea to fix this and YARN-3414 under

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390542#comment-14390542 ] Rohith commented on YARN-3430: -- +1 lgtm (non-binding) RMAppAttempt headroom data is missing

[jira] [Commented] (YARN-3286) Cleanup RMNode#ReconnectNodeTransition

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390553#comment-14390553 ] Hadoop QA commented on YARN-3286: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3301) Fix the format issue of the new RM web UI and AHS web UI

2015-04-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3301: Attachment: YARN-3301.1.patch Simple fix Fix the format issue of the new RM web UI and AHS web UI

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390616#comment-14390616 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2082 (See

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390622#comment-14390622 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2082 (See

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390623#comment-14390623 ] Hudson commented on YARN-3424: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2082 (See

[jira] [Commented] (YARN-3428) Debug log resources to be localized for a container

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390620#comment-14390620 ] Hudson commented on YARN-3428: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2082 (See

[jira] [Commented] (YARN-3412) RM tests should use MockRM where possible

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390624#comment-14390624 ] Hudson commented on YARN-3412: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2082 (See

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390638#comment-14390638 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #150 (See

[jira] [Commented] (YARN-3428) Debug log resources to be localized for a container

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390636#comment-14390636 ] Hudson commented on YARN-3428: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #150 (See

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390632#comment-14390632 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #150 (See

[jira] [Commented] (YARN-3412) RM tests should use MockRM where possible

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390640#comment-14390640 ] Hudson commented on YARN-3412: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #150 (See

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390639#comment-14390639 ] Hudson commented on YARN-3424: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #150 (See

[jira] [Commented] (YARN-3412) RM tests should use MockRM where possible

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390662#comment-14390662 ] Hudson commented on YARN-3412: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #141 (See

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390660#comment-14390660 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #141 (See

[jira] [Commented] (YARN-3428) Debug log resources to be localized for a container

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390658#comment-14390658 ] Hudson commented on YARN-3428: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #141 (See

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390654#comment-14390654 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #141 (See

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390661#comment-14390661 ] Hudson commented on YARN-3424: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #141 (See

[jira] [Updated] (YARN-2467) Add SpanReceiverHost to ResourceManager

2015-04-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-2467: --- Summary: Add SpanReceiverHost to ResourceManager (was: Add SpanReceiverHost to YARN daemons )

[jira] [Updated] (YARN-2467) Add SpanReceiverHost to ResourceManager

2015-04-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-2467: --- Component/s: (was: nodemanager) Add SpanReceiverHost to ResourceManager

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390766#comment-14390766 ] Hadoop QA commented on YARN-3430: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-04-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3334: - Attachment: YARN-3334-v5.patch Upload v5 patch with addressing all review comments above. For using

[jira] [Updated] (YARN-2467) Add SpanReceiverHost to ResourceManager

2015-04-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-2467: --- Attachment: YARN-2467.001.patch I would like to narrow down the focus of this sub-task to

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-01 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390900#comment-14390900 ] Sangjin Lee commented on YARN-3391: --- Hi [~djp], The flow id identifies a distinct flow

[jira] [Commented] (YARN-3301) Fix the format issue of the new RM web UI and AHS web UI

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390791#comment-14390791 ] Hadoop QA commented on YARN-3301: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390844#comment-14390844 ] Junping Du commented on YARN-3391: -- Thanks [~zjshen] for delivering the patch! To be

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390941#comment-14390941 ] Zhijie Shen commented on YARN-3391: --- I'll put some description in the javadoc somewhere,

[jira] [Commented] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-04-01 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390670#comment-14390670 ] Devaraj K commented on YARN-3225: - This failed test is not related to the patch. {code:xml}

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390936#comment-14390936 ] Junping Du commented on YARN-3391: -- Thanks [~sjlee0] for reply quickly! That helps a lot.

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-04-01 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391738#comment-14391738 ] Rohit Agarwal commented on YARN-3415: - +1 Non-AM containers can be counted towards

[jira] [Assigned] (YARN-3432) Cluster metrics have wrong Total Memory when there is reserved memory on CS

2015-04-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned YARN-3432: -- Assignee: Brahma Reddy Battula Cluster metrics have wrong Total Memory when

[jira] [Updated] (YARN-1572) Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal

2015-04-01 Thread Kareem El Gebaly (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kareem El Gebaly updated YARN-1572: --- Attachment: YARN-1572-branch-2.3.0.001.patch Low chance to hit NPE issue in

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391864#comment-14391864 ] Zhijie Shen commented on YARN-3391: --- Sangjin, thanks for your comments, too. According to

[jira] [Commented] (YARN-3413) Node label attributes (like exclusive or not) should be able to set when addToClusterNodeLabels and shouldn't be changed during runtime

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391866#comment-14391866 ] Hadoop QA commented on YARN-3413: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391921#comment-14391921 ] Hadoop QA commented on YARN-2729: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-01 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392066#comment-14392066 ] Naganarasimha G R commented on YARN-2740: - Thanks for the review [~wangda], bq.

[jira] [Commented] (YARN-2261) YARN should have a way to run post-application cleanup

2015-04-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391872#comment-14391872 ] Vinod Kumar Vavilapalli commented on YARN-2261: --- MAPREDUCE-4099 originally

[jira] [Commented] (YARN-3432) Cluster metrics have wrong Total Memory when there is reserved memory on CS

2015-04-01 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391875#comment-14391875 ] Brahma Reddy Battula commented on YARN-3432: Reverting of YARN-656 should be

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391959#comment-14391959 ] Vrushali C commented on YARN-3391: -- For default values, workflow = appname is much more

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391972#comment-14391972 ] Hadoop QA commented on YARN-3415: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1572) Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391976#comment-14391976 ] Hadoop QA commented on YARN-1572: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392173#comment-14392173 ] Rohith commented on YARN-3410: -- For state store format in YARN-2131, discussion happened

[jira] [Commented] (YARN-1572) Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391710#comment-14391710 ] Hadoop QA commented on YARN-1572: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-04-01 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391728#comment-14391728 ] zhihai xu commented on YARN-3415: - [~ragarwal], thanks for the review. I uploaded a new

[jira] [Updated] (YARN-1572) Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal

2015-04-01 Thread Kareem El Gebaly (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kareem El Gebaly updated YARN-1572: --- Attachment: (was: 0001-Fix-for-YARN-1572.patch) Low chance to hit NPE issue in

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2015-04-01 Thread Jian Fang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391719#comment-14391719 ] Jian Fang commented on YARN-796: JIRA MAPREDUCE-6304 has been created for this purpose.

[jira] [Updated] (YARN-3382) Some of UserMetricsInfo metrics are incorrectly set to root queue metrics

2015-04-01 Thread Rohit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohit Agarwal updated YARN-3382: Target Version/s: 2.7.0 Affects Version/s: 2.2.0 2.3.0

[jira] [Comment Edited] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391864#comment-14391864 ] Zhijie Shen edited comment on YARN-3391 at 4/2/15 12:39 AM:

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-04-01 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392025#comment-14392025 ] Naganarasimha G R commented on YARN-2729: - Testcase failures not related to my jira

[jira] [Updated] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-04-01 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3415: Attachment: YARN-3415.002.patch Non-AM containers can be counted towards amResourceUsage of a fairscheduler

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-01 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391711#comment-14391711 ] Sangjin Lee commented on YARN-3391: --- OK, just to clarify, we're talking about a case

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391794#comment-14391794 ] Zhijie Shen commented on YARN-3430: --- I temporally remove this commit from branch-2.7 to

[jira] [Updated] (YARN-2369) Environment variable handling assumes values should be appended

2015-04-01 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Cote updated YARN-2369: -- Attachment: YARN-2369-1.patch I like the second idea where the user should explicitly append to the

[jira] [Commented] (YARN-3428) Debug log resources to be localized for a container

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391186#comment-14391186 ] Hudson commented on YARN-3428: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2100 (See

[jira] [Commented] (YARN-3412) RM tests should use MockRM where possible

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391190#comment-14391190 ] Hudson commented on YARN-3412: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2100 (See

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391188#comment-14391188 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2100 (See

[jira] [Commented] (YARN-3301) Fix the format issue of the new RM web UI and AHS web UI

2015-04-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391012#comment-14391012 ] Junping Du commented on YARN-3301: -- Thanks [~xgong] for delivering a patch. Does test

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391189#comment-14391189 ] Hudson commented on YARN-3424: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2100 (See

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391181#comment-14391181 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2100 (See

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-04-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391059#comment-14391059 ] Zhijie Shen commented on YARN-3334: --- bq. For using ContainerEntity to replace

  1   2   >