[jira] [Commented] (YARN-2268) Disallow formatting the RMStateStore when there is an RM running

2015-04-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390122#comment-14390122 ] Rohith commented on YARN-2268: -- Thinking on this jira, getting many questions. # How to ident

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390128#comment-14390128 ] Rohith commented on YARN-3410: -- Just like YARN-2131 is handled , I think there is choice betwe

[jira] [Commented] (YARN-3429) TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390156#comment-14390156 ] Hadoop QA commented on YARN-3429: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3424) Reduce log for ContainerMonitorImpl resoure monitoring from info to debug

2015-04-01 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390226#comment-14390226 ] Tsuyoshi Ozawa commented on YARN-3424: -- +1 with minor indentation fix on my local. Co

[jira] [Updated] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-3424: - Summary: Change logs for ContainerMonitorImpl's resourse monitoring from info to debug (was: Reduc

[jira] [Updated] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-3424: - Affects Version/s: 2.7.0 > Change logs for ContainerMonitorImpl's resourse monitoring from info to

[jira] [Updated] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-3424: - Issue Type: Improvement (was: Bug) > Change logs for ContainerMonitorImpl's resourse monitoring fr

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390243#comment-14390243 ] Hudson commented on YARN-3424: -- FAILURE: Integrated in Hadoop-trunk-Commit #7482 (See [https:

[jira] [Commented] (YARN-3261) rewrite resourcemanager restart doc to remove roadmap bits

2015-04-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390258#comment-14390258 ] Rohith commented on YARN-3261: -- Thanks [~gururaj] for the patch.. +1(non-binding) for the chan

[jira] [Updated] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-04-01 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-3225: Attachment: YARN-3225-3.patch > New parameter or CLI for decommissioning node gracefully in RMAdmin CLI > ---

[jira] [Commented] (YARN-2624) Resource Localization fails on a cluster due to existing cache directories

2015-04-01 Thread vishal.rajan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390305#comment-14390305 ] vishal.rajan commented on YARN-2624: seems like this issue still persist in yarn 2.6.0

[jira] [Updated] (YARN-2624) Resource Localization fails on a cluster due to existing cache directories

2015-04-01 Thread vishal.rajan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vishal.rajan updated YARN-2624: --- Target Version/s: (was: 2.6.0) Affects Version/s: 2.6.0 > Resource Localization fails on a clust

[jira] [Commented] (YARN-2624) Resource Localization fails on a cluster due to existing cache directories

2015-04-01 Thread vishal.rajan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390319#comment-14390319 ] vishal.rajan commented on YARN-2624: please verify and reopen the jira > Resource Loca

[jira] [Commented] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390379#comment-14390379 ] Hadoop QA commented on YARN-3225: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390407#comment-14390407 ] Xuan Gong commented on YARN-3248: - +1 lgtm. Will commit > Display count of nodes blacklist

[jira] [Assigned] (YARN-3405) FairScheduler's preemption cannot happen between sibling in some case

2015-04-01 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peng Zhang reassigned YARN-3405: Assignee: Peng Zhang > FairScheduler's preemption cannot happen between sibling in some case > -

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390412#comment-14390412 ] Xuan Gong commented on YARN-3248: - Committed into trunk/branch-2 > Display count of nodes

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390422#comment-14390422 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-trunk-Commit #7483 (See [https:

[jira] [Commented] (YARN-3428) Debug log resources to be localized for a container

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390428#comment-14390428 ] Hudson commented on YARN-3428: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #150 (See [htt

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390424#comment-14390424 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #150 (See [htt

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390430#comment-14390430 ] Hudson commented on YARN-3424: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #150 (See [htt

[jira] [Updated] (YARN-3301) Fix the format issue of the new RM web UI and AHS web UI

2015-04-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3301: Target Version/s: 2.8.0 > Fix the format issue of the new RM web UI and AHS web UI >

[jira] [Commented] (YARN-3412) RM tests should use MockRM where possible

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390431#comment-14390431 ] Hudson commented on YARN-3412: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #150 (See [htt

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390442#comment-14390442 ] Hudson commented on YARN-3424: -- FAILURE: Integrated in Hadoop-Yarn-trunk #884 (See [https://b

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390436#comment-14390436 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Yarn-trunk #884 (See [https://b

[jira] [Commented] (YARN-3428) Debug log resources to be localized for a container

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390440#comment-14390440 ] Hudson commented on YARN-3428: -- FAILURE: Integrated in Hadoop-Yarn-trunk #884 (See [https://b

[jira] [Commented] (YARN-3412) RM tests should use MockRM where possible

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390443#comment-14390443 ] Hudson commented on YARN-3412: -- FAILURE: Integrated in Hadoop-Yarn-trunk #884 (See [https://b

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390452#comment-14390452 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-trunk-Commit #7484 (See [https:

[jira] [Commented] (YARN-3405) FairScheduler's preemption cannot happen between sibling in some case

2015-04-01 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390455#comment-14390455 ] Peng Zhang commented on YARN-3405: -- I've a primitive idea to fix this and YARN-3414 under

[jira] [Updated] (YARN-3416) deadlock in a job between map and reduce cores allocation

2015-04-01 Thread mai shurong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mai shurong updated YARN-3416: -- Attachment: AM_log_head10.txt.gz AM_log_tail10.txt.gz head 10 lines and tail

[jira] [Updated] (YARN-3286) Cleanup RMNode#ReconnectNodeTransition

2015-04-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3286: - Description: RMNode#ReconnectNodeTransition has messed up for every ReconnectedEvent. This part of the code c

[jira] [Updated] (YARN-3286) Cleanup RMNode#ReconnectNodeTransition

2015-04-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3286: - Attachment: 0001-YARN-3286.patch > Cleanup RMNode#ReconnectNodeTransition > --

[jira] [Updated] (YARN-3416) deadlock in a job between map and reduce cores allocation

2015-04-01 Thread mai shurong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mai shurong updated YARN-3416: -- Attachment: queue_with_max333cores.png queue_with_max263cores.png queue_wi

[jira] [Commented] (YARN-3416) deadlock in a job between map and reduce cores allocation

2015-04-01 Thread mai shurong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390466#comment-14390466 ] mai shurong commented on YARN-3416: --- I found a new case today. I submitted a more larger

[jira] [Commented] (YARN-3405) FairScheduler's preemption cannot happen between sibling in some case

2015-04-01 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390471#comment-14390471 ] Peng Zhang commented on YARN-3405: -- bq. 2. if parent's usage reached its fair share, it w

[jira] [Created] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-3430: --- Summary: RMAppAttempt headroom data is missing in RM Web UI Key: YARN-3430 URL: https://issues.apache.org/jira/browse/YARN-3430 Project: Hadoop YARN Issue Type: Sub-ta

[jira] [Assigned] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-3430: --- Assignee: Xuan Gong > RMAppAttempt headroom data is missing in RM Web UI > ---

[jira] [Updated] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3430: Attachment: YARN-3430.1.patch trivial patch without testcase > RMAppAttempt headroom data is missing in RM W

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390542#comment-14390542 ] Rohith commented on YARN-3430: -- +1 lgtm (non-binding) > RMAppAttempt headroom data is missing

[jira] [Commented] (YARN-3286) Cleanup RMNode#ReconnectNodeTransition

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390553#comment-14390553 ] Hadoop QA commented on YARN-3286: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3301) Fix the format issue of the new RM web UI and AHS web UI

2015-04-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3301: Attachment: YARN-3301.1.patch Simple fix > Fix the format issue of the new RM web UI and AHS web UI > --

[jira] [Commented] (YARN-3412) RM tests should use MockRM where possible

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390624#comment-14390624 ] Hudson commented on YARN-3412: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2082 (See [https://

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390616#comment-14390616 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2082 (See [https://

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390622#comment-14390622 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2082 (See [https://

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390623#comment-14390623 ] Hudson commented on YARN-3424: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2082 (See [https://

[jira] [Commented] (YARN-3428) Debug log resources to be localized for a container

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390620#comment-14390620 ] Hudson commented on YARN-3428: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2082 (See [https://

[jira] [Commented] (YARN-3428) Debug log resources to be localized for a container

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390636#comment-14390636 ] Hudson commented on YARN-3428: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #150 (See

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390638#comment-14390638 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #150 (See

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390632#comment-14390632 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #150 (See

[jira] [Commented] (YARN-3412) RM tests should use MockRM where possible

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390640#comment-14390640 ] Hudson commented on YARN-3412: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #150 (See

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390639#comment-14390639 ] Hudson commented on YARN-3424: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #150 (See

[jira] [Commented] (YARN-3412) RM tests should use MockRM where possible

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390662#comment-14390662 ] Hudson commented on YARN-3412: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #141 (See [htt

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390660#comment-14390660 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #141 (See [htt

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390654#comment-14390654 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #141 (See [htt

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390661#comment-14390661 ] Hudson commented on YARN-3424: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #141 (See [htt

[jira] [Commented] (YARN-3428) Debug log resources to be localized for a container

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390658#comment-14390658 ] Hudson commented on YARN-3428: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #141 (See [htt

[jira] [Updated] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-04-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3334: - Attachment: YARN-3334-v5.patch Upload v5 patch with addressing all review comments above. For using Contain

[jira] [Commented] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-04-01 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390670#comment-14390670 ] Devaraj K commented on YARN-3225: - This failed test is not related to the patch. {code:xml}

[jira] [Updated] (YARN-2467) Add SpanReceiverHost to ResourceManager

2015-04-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-2467: --- Summary: Add SpanReceiverHost to ResourceManager (was: Add SpanReceiverHost to YARN daemons )

[jira] [Updated] (YARN-2467) Add SpanReceiverHost to ResourceManager

2015-04-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-2467: --- Component/s: (was: nodemanager) > Add SpanReceiverHost to ResourceManager > ---

[jira] [Updated] (YARN-2467) Add SpanReceiverHost to ResourceManager

2015-04-01 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-2467: --- Attachment: YARN-2467.001.patch I would like to narrow down the focus of this sub-task to Resou

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390766#comment-14390766 ] Hadoop QA commented on YARN-3430: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3301) Fix the format issue of the new RM web UI and AHS web UI

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390791#comment-14390791 ] Hadoop QA commented on YARN-3301: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390844#comment-14390844 ] Junping Du commented on YARN-3391: -- Thanks [~zjshen] for delivering the patch! To be hone

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-01 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390900#comment-14390900 ] Sangjin Lee commented on YARN-3391: --- Hi [~djp], The flow id identifies a distinct flow a

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390936#comment-14390936 ] Junping Du commented on YARN-3391: -- Thanks [~sjlee0] for reply quickly! That helps a lot.

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390941#comment-14390941 ] Zhijie Shen commented on YARN-3391: --- I'll put some description in the javadoc somewhere,

[jira] [Updated] (YARN-2369) Environment variable handling assumes values should be appended

2015-04-01 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Cote updated YARN-2369: -- Attachment: YARN-2369-1.patch I like the second idea where the user should explicitly append to the varia

[jira] [Commented] (YARN-3425) NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed

2015-04-01 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390996#comment-14390996 ] Bibin A Chundatt commented on YARN-3425: [~leftnoteasy] Thank you for looking into

[jira] [Commented] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

2015-04-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14390995#comment-14390995 ] Sunil G commented on YARN-2003: --- Thank You [~leftnoteasy] I will rebase YARN-2004 and will s

[jira] [Commented] (YARN-3301) Fix the format issue of the new RM web UI and AHS web UI

2015-04-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391012#comment-14391012 ] Junping Du commented on YARN-3301: -- Thanks [~xgong] for delivering a patch. Does test fail

[jira] [Commented] (YARN-3425) NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391021#comment-14391021 ] Hudson commented on YARN-3425: -- FAILURE: Integrated in Hadoop-trunk-Commit #7485 (See [https:

[jira] [Created] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-01 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-3431: - Summary: Sub resources of timeline entity needs to be passed to a separate endpoint. Key: YARN-3431 URL: https://issues.apache.org/jira/browse/YARN-3431 Project: Hadoop YAR

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-04-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391059#comment-14391059 ] Zhijie Shen commented on YARN-3334: --- bq. For using ContainerEntity to replace TimelineEnt

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-04-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391067#comment-14391067 ] Wangda Tan commented on YARN-2729: -- Hi [~Naganarasimha], Sorry for my late response, bq. A

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-04-01 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391102#comment-14391102 ] Naganarasimha G R commented on YARN-2729: - Thanks [~wangda] for the review, bq. I t

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391106#comment-14391106 ] Wangda Tan commented on YARN-2740: -- [~Naganarasimha], Took a look, some comments: 1) Beyo

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-04-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391118#comment-14391118 ] Wangda Tan commented on YARN-2729: -- bq. i dint want to add a new configuration to enable

[jira] [Commented] (YARN-3374) Collector's web server should randomly bind an available port

2015-04-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391131#comment-14391131 ] Junping Du commented on YARN-3374: -- Patch looks good. +1. Will commit it soon. > Collecto

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

2015-04-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391142#comment-14391142 ] Junping Du commented on YARN-3046: -- Hi [~rkanter], as I mentioned offline early, can I tak

[jira] [Commented] (YARN-2268) Disallow formatting the RMStateStore when there is an RM running

2015-04-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391166#comment-14391166 ] Karthik Kambatla commented on YARN-2268: IIRR, the store formatting is actually exe

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391179#comment-14391179 ] Vrushali C commented on YARN-3391: -- bq. Otherwise, if we use the job name, for example, al

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391152#comment-14391152 ] Wangda Tan commented on YARN-3410: -- bq. I think there is choice between start up option v

[jira] [Commented] (YARN-3428) Debug log resources to be localized for a container

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391186#comment-14391186 ] Hudson commented on YARN-3428: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2100 (See [htt

[jira] [Commented] (YARN-3412) RM tests should use MockRM where possible

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391190#comment-14391190 ] Hudson commented on YARN-3412: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2100 (See [htt

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391188#comment-14391188 ] Hudson commented on YARN-3248: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2100 (See [htt

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391189#comment-14391189 ] Hudson commented on YARN-3424: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2100 (See [htt

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-04-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391181#comment-14391181 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2100 (See [htt

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-04-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391218#comment-14391218 ] Sandy Ryza commented on YARN-3415: -- +1 > Non-AM containers can be counted towards amResou

[jira] [Commented] (YARN-1876) Document the REST APIs of timeline and generic history services

2015-04-01 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391226#comment-14391226 ] Naganarasimha G R commented on YARN-1876: - [~zjshen] & [~jianhe], Hope this is not

[jira] [Assigned] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

2015-04-01 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned YARN-3046: --- Assignee: Junping Du (was: Robert Kanter) Sure; go ahead. > [Event producers] Implement MapR

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

2015-04-01 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391248#comment-14391248 ] Anubhav Dhoot commented on YARN-3424: - Thanks [~ozawa] for the quick review and commit!

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391296#comment-14391296 ] Vrushali C commented on YARN-3391: -- I have some semantic level comments. 1) bq. public st

[jira] [Updated] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3431: -- Attachment: YARN-3431.1.patch Create a patch to treat the extended classes as the sub resources and put t

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391361#comment-14391361 ] Zhijie Shen commented on YARN-3430: --- Target 2.7 as it seems to be introduced by YARN-3379

[jira] [Updated] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3430: -- Description: (was: Target 2.7 as it seems to be introduced by YARN-3379.) > RMAppAttempt headroom da

[jira] [Updated] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3430: -- Description: Target 2.7 as it seems to be introduced by YARN-3379. Target Version/s: 2.7.0 > RMA

[jira] [Commented] (YARN-1572) Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal

2015-04-01 Thread Kareem El Gebaly (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391363#comment-14391363 ] Kareem El Gebaly commented on YARN-1572: I agree with solution. It affects version

[jira] [Commented] (YARN-2467) Add SpanReceiverHost to ResourceManager

2015-04-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391367#comment-14391367 ] Hadoop QA commented on YARN-2467: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

2015-04-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391403#comment-14391403 ] Zhijie Shen commented on YARN-3430: --- +1 LGTM Test it locally, and it works fine. > RMAp

  1   2   >