[jira] [Commented] (YARN-4382) Container hierarchy in cgroup may remain for ever after the container have be terminated

2015-11-22 Thread lachisis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021630#comment-15021630 ] lachisis commented on YARN-4382: If lots of container hierarchys remained, it will make the cpu busy of

[jira] [Commented] (YARN-4382) Container hierarchy in cgroup may remain for ever after the container have be terminated

2015-11-22 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021666#comment-15021666 ] Jun Gong commented on YARN-4382: 'release_agent' in cgroups

[jira] [Created] (YARN-4382) Container hierarchy in cgroup may remain for ever after the container have be terminated

2015-11-22 Thread lachisis (JIRA)
lachisis created YARN-4382: -- Summary: Container hierarchy in cgroup may remain for ever after the container have be terminated Key: YARN-4382 URL: https://issues.apache.org/jira/browse/YARN-4382 Project:

[jira] [Updated] (YARN-4381) Add container launchEvent and container localizeFailed metrics in container

2015-11-22 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated YARN-4381: Attachment: YARN-4381.001.patch I attach a init patch and add two new metrics in {{NodeManagerMetrics}} *

[jira] [Updated] (YARN-4165) An outstanding container request makes all nodes to be reserved causing all jobs pending

2015-11-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-4165: -- Description: We have a long running service in YARN, it has an outstanding container request that YARN

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021397#comment-15021397 ] Inigo Goiri commented on YARN-3980: --- It looks like v9 solves the issues. Let me know if you see anything

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021243#comment-15021243 ] Hadoop QA commented on YARN-3980: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021271#comment-15021271 ] Hadoop QA commented on YARN-3980: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021364#comment-15021364 ] Hadoop QA commented on YARN-3980: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-4381) Add container launchEvent and container localizeFailed metrics in container

2015-11-22 Thread Lin Yiqun (JIRA)
Lin Yiqun created YARN-4381: --- Summary: Add container launchEvent and container localizeFailed metrics in container Key: YARN-4381 URL: https://issues.apache.org/jira/browse/YARN-4381 Project: Hadoop YARN

[jira] [Commented] (YARN-3769) Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler

2015-11-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021053#comment-15021053 ] Eric Payne commented on YARN-3769: -- [~leftnoteasy], Thank you very much! > Consider user limit when

[jira] [Commented] (YARN-4379) TestWebApp failing in trunk

2015-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020948#comment-15020948 ] Steve Loughran commented on YARN-4379: -- I know its a simple patch, but I'm debating reverting

[jira] [Commented] (YARN-3456) Improve handling of incomplete TimelineEntities

2015-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021151#comment-15021151 ] Hadoop QA commented on YARN-3456: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v8.patch Tackling Karthik's comments. > Plumb resource-utilization info in node

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: (was: YARN-3980-v8.patch) > Plumb resource-utilization info in node heartbeat through to

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v8.patch Increasing timeout to 2 seconds again because unit tests fail. > Plumb

[jira] [Updated] (YARN-3456) Improve handling of incomplete TimelineEntities

2015-11-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3456: --- Attachment: YARN-3456.02.patch > Improve handling of incomplete TimelineEntities >

[jira] [Commented] (YARN-3456) Improve handling of incomplete TimelineEntities

2015-11-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021118#comment-15021118 ] Varun Saxena commented on YARN-3456: Sorry Kuhu. Had missed your comment. I will have bandwidth to

[jira] [Updated] (YARN-3456) Improve handling of incomplete TimelineEntities

2015-11-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3456: --- Attachment: YARN-3456.01.patch > Improve handling of incomplete TimelineEntities >

[jira] [Commented] (YARN-3456) Improve handling of incomplete TimelineEntities

2015-11-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021128#comment-15021128 ] Varun Saxena commented on YARN-3456: Updated a patch. Added checks at both client and server side. >

[jira] [Commented] (YARN-4298) Fix findbugs warnings in hadoop-yarn-common

2015-11-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021136#comment-15021136 ] Varun Saxena commented on YARN-4298: bq. please let me know if this is handled by you in any other

[jira] [Updated] (YARN-4380) TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails intermittently on branch-2.8

2015-11-22 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-4380: - Summary: TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails

[jira] [Updated] (YARN-1438) When a container fails, the text of the exception isn't included in the diagnostics

2015-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-1438: - Fix Version/s: 2.3.0 > When a container fails, the text of the exception isn't included in the >

[jira] [Commented] (YARN-4379) TestWebApp failing in trunk

2015-11-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021086#comment-15021086 ] Varun Saxena commented on YARN-4379: Ok...If HADOOP-12584 is reverted, it should be handled there.

[jira] [Resolved] (YARN-2444) Primary filters added after first submission not indexed, cause exceptions in logs.

2015-11-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved YARN-2444. -- Resolution: Won't Fix closing at a wontfix; its moot in ATS2 and the SPARK-1537 code does its

[jira] [Created] (YARN-4380) TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails on branch-2.8

2015-11-22 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created YARN-4380: Summary: TestResourceLocalizationService.testDownloadingResourcesOnContainerKill fails on branch-2.8 Key: YARN-4380 URL: https://issues.apache.org/jira/browse/YARN-4380

[jira] [Commented] (YARN-3456) Improve handling of incomplete TimelineEntities

2015-11-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021188#comment-15021188 ] Hadoop QA commented on YARN-3456: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021189#comment-15021189 ] Karthik Kambatla edited comment on YARN-3980 at 11/22/15 9:11 PM: -- Jenkins

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021189#comment-15021189 ] Karthik Kambatla commented on YARN-3980: Jenkins could be running on a (virtual) machine much

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021201#comment-15021201 ] Inigo Goiri commented on YARN-3980: --- Any easy place to check in the RM for the heartbeats? > Plumb

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-11-22 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v9.patch Waiting for heartbeat to propagate based on the expected value. This