[jira] [Commented] (YARN-3432) Cluster metrics have wrong Total Memory when there is reserved memory on CS

2015-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989338#comment-14989338 ] Hadoop QA commented on YARN-3432: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-1510) Make NMClient support change container resources

2015-11-04 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989637#comment-14989637 ] MENG DING commented on YARN-1510: - I just ran these tests locally with latest trunk and YAR

[jira] [Commented] (YARN-1510) Make NMClient support change container resources

2015-11-04 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989648#comment-14989648 ] MENG DING commented on YARN-1510: - Also ran the following tests, they passed: {code} -

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989664#comment-14989664 ] Karthik Kambatla commented on YARN-3980: Thanks Inigo. Looks generally good. Commen

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2015-11-04 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989697#comment-14989697 ] Kuhu Shukla commented on YARN-4311: --- [~jlowe], [~leftnoteasy], request for comments. Than

[jira] [Commented] (YARN-2047) RM should honor NM heartbeat expiry after RM restart

2015-11-04 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989769#comment-14989769 ] Jun Gong commented on YARN-2047: I think we could list cases which will cause the problem i

[jira] [Commented] (YARN-2047) RM should honor NM heartbeat expiry after RM restart

2015-11-04 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14989812#comment-14989812 ] Jun Gong commented on YARN-2047: For case 1, RM could save dead NMs in StateStore, when the

[jira] [Updated] (YARN-4292) ResourceUtilization should be a part of NodeInfo REST API

2015-11-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4292: -- Attachment: 0003-YARN-4292.patch Thank You [~leftnoteasy] Yes, its better to have a separate class for the resour

[jira] [Created] (YARN-4330) MiniYARNCluster prints multiple Failed to instantiate default resource calculator warning messages

2015-11-04 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-4330: Summary: MiniYARNCluster prints multiple Failed to instantiate default resource calculator warning messages Key: YARN-4330 URL: https://issues.apache.org/jira/browse/YARN-4330

[jira] [Commented] (YARN-4330) MiniYARNCluster prints multiple Failed to instantiate default resource calculator warning messages

2015-11-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990047#comment-14990047 ] Steve Loughran commented on YARN-4330: -- Looks like YARN-3534 triggered this. Full St

[jira] [Commented] (YARN-4330) MiniYARNCluster prints multiple Failed to instantiate default resource calculator warning messages

2015-11-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990051#comment-14990051 ] Steve Loughran commented on YARN-4330: -- As well as having a way to turn this feature o

[jira] [Updated] (YARN-3223) Resource update during NM graceful decommission

2015-11-04 Thread Brook Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brook Zhou updated YARN-3223: - Attachment: YARN-3223-v2.patch Updated patch based on feedback. Checkstyle errors about CapacityScheduler.j

[jira] [Created] (YARN-4331) Killing NodeManager leaves orphaned containers

2015-11-04 Thread Joseph (JIRA)
Joseph created YARN-4331: Summary: Killing NodeManager leaves orphaned containers Key: YARN-4331 URL: https://issues.apache.org/jira/browse/YARN-4331 Project: Hadoop YARN Issue Type: Bug Co

[jira] [Updated] (YARN-4331) Killing NodeManager leaves orphaned containers

2015-11-04 Thread Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph updated YARN-4331: - Description: We are seeing a lot of orphaned containers running in our production clusters. I tried to simulate thi

[jira] [Updated] (YARN-4331) Restarting NodeManager leaves orphaned containers

2015-11-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4331: - Summary: Restarting NodeManager leaves orphaned containers (was: Killing NodeManager leaves orphaned conta

[jira] [Commented] (YARN-4292) ResourceUtilization should be a part of NodeInfo REST API

2015-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990210#comment-14990210 ] Hadoop QA commented on YARN-4292: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-04 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v4.patch Adding utilizaiton to FIFO and Fair scheduler. > Plumb resource-utilizati

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-04 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990284#comment-14990284 ] Inigo Goiri commented on YARN-3980: --- I added the info to the FIFO and Fair schedulers. I'

[jira] [Commented] (YARN-4314) Adding container wait time as a metric at queue level and application level.

2015-11-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990346#comment-14990346 ] Karthik Kambatla commented on YARN-4314: bq. I feel adding timestamp to each resour

[jira] [Commented] (YARN-4032) Corrupted state from a previous version can still cause RM to fail with NPE due to same reasons as YARN-2834

2015-11-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990399#comment-14990399 ] Karthik Kambatla commented on YARN-4032: [~jianhe]'s suggestion makes sense to me.

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2015-11-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990565#comment-14990565 ] Jason Lowe commented on YARN-4311: -- Thanks for the patch, Kuhu! Test failures are related

[jira] [Assigned] (YARN-4330) MiniYARNCluster prints multiple Failed to instantiate default resource calculator warning messages

2015-11-04 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-4330: -- Assignee: Varun Saxena > MiniYARNCluster prints multiple Failed to instantiate default resource

[jira] [Created] (YARN-4332) UI timestamps are unconditionally rendered in browser timezone

2015-11-04 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-4332: Summary: UI timestamps are unconditionally rendered in browser timezone Key: YARN-4332 URL: https://issues.apache.org/jira/browse/YARN-4332 Project: Hadoop YARN Iss

[jira] [Commented] (YARN-570) Time strings are formated in different timezone

2015-11-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990603#comment-14990603 ] Jason Lowe commented on YARN-570: - So this changed timestamps to be rendered unconditionally

[jira] [Commented] (YARN-3223) Resource update during NM graceful decommission

2015-11-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990702#comment-14990702 ] Hadoop QA commented on YARN-3223: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-2882) Introducing container types

2015-11-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990881#comment-14990881 ] Arun Suresh commented on YARN-2882: --- Thanks for the patch [~kkaranasos]. The patch looks

[jira] [Assigned] (YARN-2885) LocalRM: distributed scheduling decisions for queueable containers

2015-11-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-2885: - Assignee: Arun Suresh > LocalRM: distributed scheduling decisions for queueable containers > -

[jira] [Created] (YARN-4333) Fair scheduler should support preemption within queue

2015-11-04 Thread Tao Jie (JIRA)
Tao Jie created YARN-4333: - Summary: Fair scheduler should support preemption within queue Key: YARN-4333 URL: https://issues.apache.org/jira/browse/YARN-4333 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-2047) RM should honor NM heartbeat expiry after RM restart

2015-11-04 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991069#comment-14991069 ] Bikas Saha commented on YARN-2047: -- >From the description it seems like the original scope

[jira] [Commented] (YARN-4292) ResourceUtilization should be a part of NodeInfo REST API

2015-11-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991253#comment-14991253 ] Sunil G commented on YARN-4292: --- Test case failures seems unrelated. > ResourceUtilization s

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-11-04 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14991260#comment-14991260 ] Naganarasimha G R commented on YARN-2934: - Can one of the watchers, please take a l