[jira] [Updated] (YARN-4499) Bad config values of "yarn.scheduler.maximum-allocation-vcores"

2015-12-24 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated YARN-4499: - Description: Currently, the default value of {{yarn.scheduler.maximum-allocation-vcores}} is {{32}},

[jira] [Updated] (YARN-4499) Bad config values of "yarn.scheduler.maximum-allocation-vcores"

2015-12-24 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated YARN-4499: - Description: Currently, the default value of {{yarn.scheduler.maximum-allocation-vcores}} is {{4}},

[jira] [Commented] (YARN-1856) cgroups based memory monitoring for containers

2015-12-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071322#comment-15071322 ] Karthik Kambatla commented on YARN-1856: bq. Ideally oom_control, swappiness would be set by the

[jira] [Comment Edited] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

2015-12-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071335#comment-15071335 ] Karthik Kambatla edited comment on YARN-1011 at 12/25/15 2:45 AM: -- Just

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-24 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071392#comment-15071392 ] Gera Shegalov commented on YARN-2934: - +1 for YARN-2934.v2.004.patch. There is an extra space in "Error

[jira] [Commented] (YARN-4138) Roll back container resource allocation after resource increase token expires

2015-12-24 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071403#comment-15071403 ] sandflee commented on YARN-4138: Hi, [~mding], sorry for the late reply, 1, If AM send tokenA succ to NM,

[jira] [Commented] (YARN-4506) Application was killed by a resourcemanager, In the JobHistory Can't see the job detail

2015-12-24 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071325#comment-15071325 ] tangshangwen commented on YARN-4506: I found when the MRAppMaster received a signal, the thread is not

[jira] [Created] (YARN-4508) The mount_cgroup method in container-executor.c should enhance mount check when mount the request cgroup controller.

2015-12-24 Thread Bob (JIRA)
Bob created YARN-4508: - Summary: The mount_cgroup method in container-executor.c should enhance mount check when mount the request cgroup controller. Key: YARN-4508 URL: https://issues.apache.org/jira/browse/YARN-4508

[jira] [Updated] (YARN-4508) The mount_cgroup method in container-executor.c should enhance mount check when mount the request cgroup controller.

2015-12-24 Thread Bob (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob updated YARN-4508: -- Description: In one scenarios , could result in mount_cgroup return success, but actually the request cgroup controller

[jira] [Updated] (YARN-4500) Missing default config values in docs

2015-12-24 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated YARN-4500: - Summary: Missing default config values in docs (was: Obsolete and missing default config values in docs)

[jira] [Updated] (YARN-4500) Missing default config values in docs

2015-12-24 Thread Tianyin Xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tianyin Xu updated YARN-4500: - Description: The docs

[jira] [Updated] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

2015-12-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1011: --- Attachment: yarn-1011-design-v0.pdf > [Umbrella] Schedule containers based on utilization of

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071408#comment-15071408 ] Hudson commented on YARN-2934: -- FAILURE: Integrated in Hadoop-trunk-Commit #9024 (See

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-12-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071225#comment-15071225 ] Junping Du commented on YARN-4234: -- Thanks all for fixing this. :) > New put APIs in TimelineClient for

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2015-12-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071166#comment-15071166 ] Hadoop QA commented on YARN-3998: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071124#comment-15071124 ] Hadoop QA commented on YARN-4505: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-12-24 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070805#comment-15070805 ] Tsuyoshi Ozawa commented on YARN-4234: -- [~djp] [~iwasakims] committed addendum patch by Masatake to

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-12-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070808#comment-15070808 ] Hudson commented on YARN-4234: -- FAILURE: Integrated in Hadoop-trunk-Commit #9023 (See

[jira] [Commented] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

2015-12-24 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070736#comment-15070736 ] Sangjin Lee commented on YARN-4224: --- +1. It is a valid point that we don't want implementations to affect

[jira] [Updated] (YARN-4462) FairScheduler: Disallow preemption from a queue

2015-12-24 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-4462: -- Attachment: YARN-4462.003.patch > FairScheduler: Disallow preemption from a queue >

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-12-24 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070799#comment-15070799 ] Tsuyoshi Ozawa commented on YARN-4234: -- [~iwasakims] thanks for following up. +1, checking this in.

[jira] [Commented] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071097#comment-15071097 ] Hadoop QA commented on YARN-4505: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4505: Attachment: YARN-4505.v1.002.patch test case failure is passing locally but {{throws

[jira] [Resolved] (YARN-4507) Application was killed by a resourcemanager, In the JobHistory Can't see the job detail

2015-12-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-4507. Resolution: Duplicate Assignee: Daniel Templeton > Application was killed by a

[jira] [Commented] (YARN-4506) Application was killed by a resourcemanager, In the JobHistory Can't see the job detail

2015-12-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071106#comment-15071106 ] Daniel Templeton commented on YARN-4506: Are you sure you're on 2.2? That's pretty darned old.

[jira] [Updated] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2015-12-24 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-3998: --- Attachment: YARN-3998.01.patch > Add retry-times to let NM re-launch container when it fails to run >

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2015-12-24 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071113#comment-15071113 ] Jun Gong commented on YARN-3998: Sorry for late. I just attached a patch for review, will add test cases

[jira] [Updated] (YARN-4506) Application was killed by a resourcemanager, In the JobHistory Can't see the job detail

2015-12-24 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tangshangwen updated YARN-4506: --- Attachment: am.rar i update my am.log > Application was killed by a resourcemanager, In the

[jira] [Commented] (YARN-4506) Application was killed by a resourcemanager, In the JobHistory Can't see the job detail

2015-12-24 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071119#comment-15071119 ] tangshangwen commented on YARN-4506: I'm sure it happened in 2.2,because i fond AM was kill by RM,I

[jira] [Assigned] (YARN-4183) Enabling generic application history forces every job to get a timeline service delegation token

2015-12-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-4183: --- Assignee: Naganarasimha G R (was: Mit Desai) > Enabling generic application history

[jira] [Created] (YARN-4504) Retrospect on defaults for created time while querying

2015-12-24 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-4504: -- Summary: Retrospect on defaults for created time while querying Key: YARN-4504 URL: https://issues.apache.org/jira/browse/YARN-4504 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-12-24 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070915#comment-15070915 ] Tsuyoshi Ozawa commented on YARN-4234: -- sorry, I just forgot to push. thanks for following up! > New

[jira] [Commented] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070939#comment-15070939 ] Naganarasimha G R commented on YARN-4505: - you can reassign if required ! >

[jira] [Commented] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070944#comment-15070944 ] Varun Saxena commented on YARN-4505: The relevant patch file is YARN-4234.2015-12-21.1.patch . Maybe

[jira] [Assigned] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-4505: --- Assignee: Naganarasimha G R > TestJobHistoryEventHandler.testTimelineEventHandling

[jira] [Commented] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070941#comment-15070941 ] Varun Saxena commented on YARN-4505: Well the NPE is due to TimelineWriter being null and class

[jira] [Commented] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070942#comment-15070942 ] Varun Saxena commented on YARN-4505: Its ok. You can work on it. >

[jira] [Created] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Tsuyoshi Ozawa (JIRA)
Tsuyoshi Ozawa created YARN-4505: Summary: TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE Key: YARN-4505 URL: https://issues.apache.org/jira/browse/YARN-4505

[jira] [Commented] (YARN-4462) FairScheduler: Disallow preemption from a queue

2015-12-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070912#comment-15070912 ] Hadoop QA commented on YARN-4462: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2934) Improve handling of container's stderr

2015-12-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070917#comment-15070917 ] Hadoop QA commented on YARN-2934: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070933#comment-15070933 ] Varun Saxena commented on YARN-4505: Basically TimelineWriter in TimelineClientImpl is created in

[jira] [Updated] (YARN-2934) Improve handling of container's stderr

2015-12-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2934: Attachment: YARN-2934.v2.004.patch Thanks for the comments [~jira.shegalov], bq. Things we

[jira] [Commented] (YARN-4234) New put APIs in TimelineClient for ats v1.5

2015-12-24 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070868#comment-15070868 ] Akira AJISAKA commented on YARN-4234: - bq. committed addendum patch by Masatake to trunk and

[jira] [Commented] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070919#comment-15070919 ] Varun Saxena commented on YARN-4505: This seems to be broken by YARN-4234. Should it be fixed as

[jira] [Commented] (YARN-4393) TestResourceLocalizationService#testFailedDirsResourceRelease fails intermittently

2015-12-24 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070936#comment-15070936 ] Varun Saxena commented on YARN-4393: [~ozawa], kindly look at the analysis above. And whether you agree

[jira] [Commented] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070935#comment-15070935 ] Naganarasimha G R commented on YARN-4505: - [~varun_saxena], dint see these comments did the same

[jira] [Commented] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070948#comment-15070948 ] Naganarasimha G R commented on YARN-4505: - Obviously the stack trace is also showing the same code.

[jira] [Commented] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070968#comment-15070968 ] Varun Saxena commented on YARN-4505: [~Naganarasimha], Ok... I am not suggesting that there is

[jira] [Updated] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4505: --- Labels: test (was: ) > TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because >

[jira] [Updated] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4505: Attachment: (was: YARN-4505.v1.001.patch) >

[jira] [Updated] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4505: Attachment: YARN-4505.v1.001.patch Thanks [~varun_saxena], got what you meant ! Any way

[jira] [Updated] (YARN-4505) TestJobHistoryEventHandler.testTimelineEventHandling fails on trunk because of NPE

2015-12-24 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4505: Attachment: YARN-4505.v1.001.patch > TestJobHistoryEventHandler.testTimelineEventHandling

[jira] [Created] (YARN-4506) Application was killed by a resourcemanager, In the JobHistory Can't see the job detail

2015-12-24 Thread tangshangwen (JIRA)
tangshangwen created YARN-4506: -- Summary: Application was killed by a resourcemanager, In the JobHistory Can't see the job detail Key: YARN-4506 URL: https://issues.apache.org/jira/browse/YARN-4506

[jira] [Created] (YARN-4507) Application was killed by a resourcemanager, In the JobHistory Can't see the job detail

2015-12-24 Thread tangshangwen (JIRA)
tangshangwen created YARN-4507: -- Summary: Application was killed by a resourcemanager, In the JobHistory Can't see the job detail Key: YARN-4507 URL: https://issues.apache.org/jira/browse/YARN-4507

[jira] [Commented] (YARN-4138) Roll back container resource allocation after resource increase token expires

2015-12-24 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15071080#comment-15071080 ] MENG DING commented on YARN-4138: - Hi, [~jianhe] I just tried to apply the patch on the latest trunk, and

[jira] [Updated] (YARN-4507) Application was killed by a resourcemanager, In the JobHistory Can't see the job detail

2015-12-24 Thread tangshangwen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tangshangwen updated YARN-4507: --- Description: when the AppMaster was killed by RM, we can't see the job detail in jobhistory,this is