[jira] [Commented] (YARN-3390) RMTimelineCollector should have the context info of each app

2015-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493667#comment-14493667 ] Hadoop QA commented on YARN-3390: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage

2015-04-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493632#comment-14493632 ] Allen Wittenauer commented on YARN-3348: Sorry, I've been traveling. But we need

[jira] [Commented] (YARN-3390) RMTimelineCollector should have the context info of each app

2015-04-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493659#comment-14493659 ] Zhijie Shen commented on YARN-3390: --- Thanks for sharing your idea, Naga! Thinking about

[jira] [Updated] (YARN-3390) RMTimelineCollector should have the context info of each app

2015-04-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3390: -- Attachment: YARN-3390.1.patch RMTimelineCollector should have the context info of each app

[jira] [Commented] (YARN-3451) Add start time and Elapsed in ApplicationAttemptReport and display the same in RMAttemptBlock WebUI

2015-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493705#comment-14493705 ] Hadoop QA commented on YARN-3451: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-3484) Fix up yarn top shell code

2015-04-14 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-3484: -- Summary: Fix up yarn top shell code Key: YARN-3484 URL: https://issues.apache.org/jira/browse/YARN-3484 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-14 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493636#comment-14493636 ] Sidharta Seethana commented on YARN-3366: - The findbugs warnings are fixed. The

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493626#comment-14493626 ] Hadoop QA commented on YARN-3366: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-04-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493662#comment-14493662 ] Zhijie Shen commented on YARN-3044: --- bq. correct it when i/Zhijie Shen work on YARN-3390,

[jira] [Commented] (YARN-3436) Doc WebServicesIntro.html Example Rest API url wrong

2015-04-14 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493676#comment-14493676 ] Bibin A Chundatt commented on YARN-3436: [~ozawa] Could you please review the same

[jira] [Commented] (YARN-3389) Avoid race conditions when attempts operate on shared states concurrently

2015-04-14 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493716#comment-14493716 ] Jun Gong commented on YARN-3389: [~jianhe] Thank you for the explanation. I thought RM's

[jira] [Resolved] (YARN-2973) Capacity scheduler configuration ACLs not work.

2015-04-14 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith resolved YARN-2973. -- Resolution: Invalid Closing as Invalid. Feel free to discuss and reopen again. For configuring queue level Acl's

[jira] [Commented] (YARN-3266) RMContext inactiveNodes should have NodeId as map key

2015-04-14 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493847#comment-14493847 ] Chengbing Liu commented on YARN-3266: - I agree with you. Will upload a new version with

[jira] [Commented] (YARN-3394) WebApplication proxy documentation is incomplete

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493946#comment-14493946 ] Hudson commented on YARN-3394: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #163 (See

[jira] [Commented] (YARN-3347) Improve YARN log command to get AMContainer logs as well as running containers logs

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493940#comment-14493940 ] Hudson commented on YARN-3347: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #163 (See

[jira] [Commented] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493934#comment-14493934 ] Hudson commented on YARN-3443: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #163 (See

[jira] [Commented] (YARN-3469) ZKRMStateStore: Avoid setting watches that are not required

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493935#comment-14493935 ] Hudson commented on YARN-3469: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #163 (See

[jira] [Commented] (YARN-3382) Some of UserMetricsInfo metrics are incorrectly set to root queue metrics

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493941#comment-14493941 ] Hudson commented on YARN-3382: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #163 (See

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-04-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494002#comment-14494002 ] Junping Du commented on YARN-3212: -- Thanks [~rohithsharma] for comments! bq. I gone

[jira] [Commented] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494023#comment-14494023 ] Hadoop QA commented on YARN-3225: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3347) Improve YARN log command to get AMContainer logs as well as running containers logs

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493987#comment-14493987 ] Hudson commented on YARN-3347: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #154 (See

[jira] [Commented] (YARN-3382) Some of UserMetricsInfo metrics are incorrectly set to root queue metrics

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493974#comment-14493974 ] Hudson commented on YARN-3382: -- FAILURE: Integrated in Hadoop-Yarn-trunk #897 (See

[jira] [Commented] (YARN-3472) Possible leak in DelegationTokenRenewer#allTokens

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493986#comment-14493986 ] Hudson commented on YARN-3472: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #154 (See

[jira] [Commented] (YARN-3394) WebApplication proxy documentation is incomplete

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493993#comment-14493993 ] Hudson commented on YARN-3394: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #154 (See

[jira] [Commented] (YARN-3472) Possible leak in DelegationTokenRenewer#allTokens

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493972#comment-14493972 ] Hudson commented on YARN-3472: -- FAILURE: Integrated in Hadoop-Yarn-trunk #897 (See

[jira] [Commented] (YARN-3469) ZKRMStateStore: Avoid setting watches that are not required

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493968#comment-14493968 ] Hudson commented on YARN-3469: -- FAILURE: Integrated in Hadoop-Yarn-trunk #897 (See

[jira] [Commented] (YARN-3472) Possible leak in DelegationTokenRenewer#allTokens

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493939#comment-14493939 ] Hudson commented on YARN-3472: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #163 (See

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-04-14 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493912#comment-14493912 ] Rohith commented on YARN-3212: -- Hi [~djp], Thanks for working on this improvement.. I gone

[jira] [Commented] (YARN-3469) ZKRMStateStore: Avoid setting watches that are not required

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493952#comment-14493952 ] Hudson commented on YARN-3469: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2095 (See

[jira] [Commented] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493951#comment-14493951 ] Hudson commented on YARN-3443: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2095 (See

[jira] [Commented] (YARN-3347) Improve YARN log command to get AMContainer logs as well as running containers logs

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493957#comment-14493957 ] Hudson commented on YARN-3347: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2095 (See

[jira] [Commented] (YARN-3472) Possible leak in DelegationTokenRenewer#allTokens

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493956#comment-14493956 ] Hudson commented on YARN-3472: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2095 (See

[jira] [Commented] (YARN-3382) Some of UserMetricsInfo metrics are incorrectly set to root queue metrics

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493958#comment-14493958 ] Hudson commented on YARN-3382: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2095 (See

[jira] [Commented] (YARN-3394) WebApplication proxy documentation is incomplete

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493963#comment-14493963 ] Hudson commented on YARN-3394: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2095 (See

[jira] [Commented] (YARN-3469) ZKRMStateStore: Avoid setting watches that are not required

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493982#comment-14493982 ] Hudson commented on YARN-3469: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #154 (See

[jira] [Commented] (YARN-3347) Improve YARN log command to get AMContainer logs as well as running containers logs

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493973#comment-14493973 ] Hudson commented on YARN-3347: -- FAILURE: Integrated in Hadoop-Yarn-trunk #897 (See

[jira] [Commented] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493981#comment-14493981 ] Hudson commented on YARN-3443: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #154 (See

[jira] [Commented] (YARN-3394) WebApplication proxy documentation is incomplete

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493979#comment-14493979 ] Hudson commented on YARN-3394: -- FAILURE: Integrated in Hadoop-Yarn-trunk #897 (See

[jira] [Commented] (YARN-3382) Some of UserMetricsInfo metrics are incorrectly set to root queue metrics

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493988#comment-14493988 ] Hudson commented on YARN-3382: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #154 (See

[jira] [Commented] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493967#comment-14493967 ] Hudson commented on YARN-3443: -- FAILURE: Integrated in Hadoop-Yarn-trunk #897 (See

[jira] [Commented] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-04-14 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494377#comment-14494377 ] Rohith commented on YARN-3225: -- Thanks [~devaraj.k] for patch and [~djp] for review. Overall

[jira] [Commented] (YARN-3361) CapacityScheduler side changes to support non-exclusive node labels

2015-04-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494471#comment-14494471 ] Jian He commented on YARN-3361: --- patch looks good to me overall. [~nroberts], thanks for

[jira] [Updated] (YARN-3474) Add a way to let NM wait RM to come back, not kill running containers

2015-04-14 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-3474: --- Attachment: YARN-3474.01.patch Run 'bin/yarn waitrm', then just wait RM to come back, and press 'Enter' to

[jira] [Commented] (YARN-3266) RMContext inactiveNodes should have NodeId as map key

2015-04-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494483#comment-14494483 ] Jian He commented on YARN-3266: --- +1 RMContext inactiveNodes should have NodeId as map key

[jira] [Commented] (YARN-3474) Add a way to let NM wait RM to come back, not kill running containers

2015-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494424#comment-14494424 ] Hadoop QA commented on YARN-3474: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

2015-04-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494396#comment-14494396 ] Wangda Tan commented on YARN-3318: -- Beyond SchedulerApplicationAttempt which is pending

[jira] [Commented] (YARN-3361) CapacityScheduler side changes to support non-exclusive node labels

2015-04-14 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494490#comment-14494490 ] Nathan Roberts commented on YARN-3361: -- A follow-up jira is ok. We can take care of it

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494524#comment-14494524 ] Sangjin Lee commented on YARN-3437: --- Forgot to add that I copied it to get the load

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494521#comment-14494521 ] Sangjin Lee commented on YARN-3437: --- Thanks [~djp] for your comments! I agree with most

[jira] [Commented] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494202#comment-14494202 ] Hudson commented on YARN-3443: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #164 (See

[jira] [Commented] (YARN-3469) ZKRMStateStore: Avoid setting watches that are not required

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494203#comment-14494203 ] Hudson commented on YARN-3469: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #164 (See

[jira] [Commented] (YARN-3382) Some of UserMetricsInfo metrics are incorrectly set to root queue metrics

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494211#comment-14494211 ] Hudson commented on YARN-3382: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #164 (See

[jira] [Commented] (YARN-3394) WebApplication proxy documentation is incomplete

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494215#comment-14494215 ] Hudson commented on YARN-3394: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #164 (See

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-04-14 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494253#comment-14494253 ] Rohith commented on YARN-3212: -- bq. This should be changed after this patch I see.. I missed

[jira] [Commented] (YARN-3347) Improve YARN log command to get AMContainer logs as well as running containers logs

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494278#comment-14494278 ] Hudson commented on YARN-3347: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2113 (See

[jira] [Commented] (YARN-3347) Improve YARN log command to get AMContainer logs as well as running containers logs

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494210#comment-14494210 ] Hudson commented on YARN-3347: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #164 (See

[jira] [Commented] (YARN-3469) ZKRMStateStore: Avoid setting watches that are not required

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494272#comment-14494272 ] Hudson commented on YARN-3469: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2113 (See

[jira] [Commented] (YARN-3472) Possible leak in DelegationTokenRenewer#allTokens

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494277#comment-14494277 ] Hudson commented on YARN-3472: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2113 (See

[jira] [Commented] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494271#comment-14494271 ] Hudson commented on YARN-3443: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2113 (See

[jira] [Commented] (YARN-3382) Some of UserMetricsInfo metrics are incorrectly set to root queue metrics

2015-04-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494279#comment-14494279 ] Hudson commented on YARN-3382: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2113 (See

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

2015-04-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14494233#comment-14494233 ] Junping Du commented on YARN-3046: -- Thanks [~zjshen] for review and comments! bq. I'm not

[jira] [Updated] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-14 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3411: - Attachment: YARN-3411.poc.1 Attaching a patch for this schema option. I am still working on refining this

[jira] [Updated] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-14 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3411: - Attachment: (was: YARN-3411.poc.1) [Storage implementation] explore the native HBase write schema for

[jira] [Updated] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-14 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3411: - Attachment: YARN-3411.poc.txt [Storage implementation] explore the native HBase write schema for storage

[jira] [Updated] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3134: Attachment: YARN-3134-041415_poc.patch Add support to events and metrics. We need to figure out a better way to

[jira] [Updated] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-04-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1462: Attachment: YARN-1462.1.patch AHS API and other AHS changes to handle tags for completed MR jobs

[jira] [Resolved] (YARN-2658) Improve CLI to fetch latest logs for running applications

2015-04-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong resolved YARN-2658. - Resolution: Fixed Improve CLI to fetch latest logs for running applications

[jira] [Commented] (YARN-2658) Improve CLI to fetch latest logs for running applications

2015-04-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495525#comment-14495525 ] Xuan Gong commented on YARN-2658: - Sorry, this issue is fixed in

[jira] [Commented] (YARN-2659) Improve Web UI to fetch latest logs for Running applications

2015-04-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495526#comment-14495526 ] Xuan Gong commented on YARN-2659: - This issue is fixed in YARN-1809. Close this Improve

[jira] [Resolved] (YARN-2659) Improve Web UI to fetch latest logs for Running applications

2015-04-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong resolved YARN-2659. - Resolution: Fixed Improve Web UI to fetch latest logs for Running applications

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

2015-04-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495534#comment-14495534 ] Junping Du commented on YARN-3046: -- Also, verify end-to-end test for putting MR history

[jira] [Commented] (YARN-3451) Add start time and Elapsed in ApplicationAttemptReport and display the same in RMAttemptBlock WebUI

2015-04-14 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495165#comment-14495165 ] Rohith commented on YARN-3451: -- [~jianhe] Kindly review the updated patch.. Screenshot is

[jira] [Commented] (YARN-3487) CapacityScheduler scheduler lock obtained unnecessarily

2015-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495195#comment-14495195 ] Hadoop QA commented on YARN-3487: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3485) FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies

2015-04-14 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495466#comment-14495466 ] Anubhav Dhoot commented on YARN-3485: - Looks like a good change. This makes the

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

2015-04-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495462#comment-14495462 ] Robert Kanter commented on YARN-3046: - Sure, another JIRA sounds fine. [Event

[jira] [Commented] (YARN-3354) Container should contains node-labels asked by original ResourceRequests

2015-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495495#comment-14495495 ] Hadoop QA commented on YARN-3354: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-3488) AM get timeline service info from RM rather than Application specific configuration.

2015-04-14 Thread Junping Du (JIRA)
Junping Du created YARN-3488: Summary: AM get timeline service info from RM rather than Application specific configuration. Key: YARN-3488 URL: https://issues.apache.org/jira/browse/YARN-3488 Project:

[jira] [Updated] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

2015-04-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3046: - Attachment: YARN-3046-v2.patch Update patch to v2 for incorporate comments from [~zjshen] and [~rkanter].

[jira] [Commented] (YARN-3485) FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies

2015-04-14 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495573#comment-14495573 ] Peng Zhang commented on YARN-3485: -- {code} +maxAvailableResource.setMemory( +

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495579#comment-14495579 ] Hadoop QA commented on YARN-1462: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495589#comment-14495589 ] Zhijie Shen commented on YARN-3051: --- bq. In phoenix, PKs cannot be identical. In hbase,

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495596#comment-14495596 ] Sangjin Lee commented on YARN-3051: --- Basically attempts to create a new row in the entity

[jira] [Commented] (YARN-3390) Reuse TimelineCollectorManager for RM

2015-04-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495615#comment-14495615 ] Sangjin Lee commented on YARN-3390: --- Thanks [~Naganarasimha] and [~zjshen]! I'll take a

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495162#comment-14495162 ] Wangda Tan commented on YARN-3434: -- [~tgraves], I understand the motivation of doing this,

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495180#comment-14495180 ] Li Lu commented on YARN-3134: - Hi [~vrushalic], thanks for the note! Yes events and metrics are

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495177#comment-14495177 ] Zhijie Shen commented on YARN-3051: --- bq. Is there a strong reason to alter the

[jira] [Commented] (YARN-3127) Apphistory url crashes when RM switches with ATS enabled

2015-04-14 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495444#comment-14495444 ] Naganarasimha G R commented on YARN-3127: - Thanks for the review [~xgong], Good

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495481#comment-14495481 ] Sangjin Lee commented on YARN-3051: --- {quote} Yeah, that's another part where I'm a bit

[jira] [Updated] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

2015-04-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1402: Attachment: YARN-1402.1.patch Related Web UI, CLI changes on exposing client API to check log aggregation

[jira] [Commented] (YARN-3485) FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies

2015-04-14 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495593#comment-14495593 ] Peng Zhang commented on YARN-3485: -- some thoughts for this issue: # I think for fair and

[jira] [Updated] (YARN-3462) Patches applied for YARN-2424 are inconsistent between trunk and branch-2

2015-04-14 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated YARN-3462: -- Target Version/s: 2.8.0, 2.7.1 Hadoop Flags: Reviewed Thanks [~Naganarasimha], lgtm, +1. Committing

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

2015-04-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495191#comment-14495191 ] Junping Du commented on YARN-3046: -- Thanks [~rkanter] for review and comments! bq. I think

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-04-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495494#comment-14495494 ] Li Lu commented on YARN-3051: - bq. Want to loop in Li Lu and Vrushali C. Guys, would it be a

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495519#comment-14495519 ] Hadoop QA commented on YARN-3134: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3266) RMContext inactiveNodes should have NodeId as map key

2015-04-14 Thread Chengbing Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495543#comment-14495543 ] Chengbing Liu commented on YARN-3266: - Thanks [~jianhe] for review and committing!

[jira] [Assigned] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-04-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-1462: --- Assignee: Xuan Gong AHS API and other AHS changes to handle tags for completed MR jobs

[jira] [Commented] (YARN-3390) Reuse TimelineCollectorManager for RM

2015-04-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495169#comment-14495169 ] Li Lu commented on YARN-3390: - I think for the problem of dependencies, our current project

[jira] [Commented] (YARN-2696) Queue sorting in CapacityScheduler should consider node label

2015-04-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495200#comment-14495200 ] Jian He commented on YARN-2696: --- We can merge PartitionedQueueComparator and

[jira] [Updated] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-04-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1462: Target Version/s: 2.7.1 AHS API and other AHS changes to handle tags for completed MR jobs

[jira] [Commented] (YARN-2658) Improve CLI to fetch latest logs for running applications

2015-04-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495523#comment-14495523 ] Xuan Gong commented on YARN-2658: - This issue is fixed in YARN-1809. Close this. Improve

  1   2   >