[jira] [Commented] (YARN-3999) RM hangs on draing events

2015-08-11 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682496#comment-14682496 ] Xuan Gong commented on YARN-3999: - +1 lgtm. Will commit later if there are no other

[jira] [Commented] (YARN-4046) Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST

2015-08-11 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14687395#comment-14687395 ] Anubhav Dhoot commented on YARN-4046: - [~cnauroth] appreciate your review

[jira] [Updated] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-11 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3045: Attachment: YARN-3045-YARN-2928.009.patch Hi [~djp], Attaching a new patching resolving your

[jira] [Commented] (YARN-4045) Negative avaialbleMB is being reported for root queue.

2015-08-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14687389#comment-14687389 ] Wangda Tan commented on YARN-4045: -- [~tgraves]/[~shahrs87], I think the case could

[jira] [Updated] (YARN-4046) Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST

2015-08-11 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4046: Attachment: YARN-4096.001.patch Attaching patch that prefixes -- when using negative pid for kill

[jira] [Commented] (YARN-4026) FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource requests

2015-08-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14687398#comment-14687398 ] Jian He commented on YARN-4026: --- - why assignment.setFulfilledReservation(true); is called in

[jira] [Updated] (YARN-4046) Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST

2015-08-11 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4046: Description: On a debian machine we have seen node manager recovery of containers fail because the

[jira] [Commented] (YARN-2657) MiniYARNCluster to (optionally) add MicroZookeeper service

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692525#comment-14692525 ] Sangjin Lee commented on YARN-2657: --- Should this be targeted to 2.6.2? We're trying to

[jira] [Commented] (YARN-2599) Standby RM should also expose some jmx and metrics

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692526#comment-14692526 ] Sangjin Lee commented on YARN-2599: --- Should this be targeted to 2.6.2? We're trying to

[jira] [Commented] (YARN-2746) YARNDelegationTokenID misses serializing version from the common abstract ID

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692523#comment-14692523 ] Sangjin Lee commented on YARN-2746: --- Should this be targeted to 2.6.2? We're trying to

[jira] [Commented] (YARN-3478) FairScheduler page not performed because different enum of YarnApplicationState and RMAppState

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692520#comment-14692520 ] Sangjin Lee commented on YARN-3478: --- Should this be targeted to 2.6.2? We're trying to

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692524#comment-14692524 ] Hadoop QA commented on YARN-3045: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-2457) FairScheduler: Handle preemption to help starved parent queues

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692528#comment-14692528 ] Sangjin Lee commented on YARN-2457: --- Should this be targeted to 2.6.2? We're trying to

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692521#comment-14692521 ] Sangjin Lee commented on YARN-2859: --- Should this be targeted to 2.6.2? We're trying to

[jira] [Commented] (YARN-2038) Revisit how AMs learn of containers from previous attempts

2015-08-11 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692709#comment-14692709 ] sandflee commented on YARN-2038: I thought it's the same issue to YARN-3519, but it seems

[jira] [Commented] (YARN-3999) RM hangs on draing events

2015-08-11 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692729#comment-14692729 ] Xuan Gong commented on YARN-3999: - Thanks, Jian. Committed into trunk/branch-2/branch-2.7.

[jira] [Commented] (YARN-4047) ClientRMService getApplications has high scheduler lock contention

2015-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692412#comment-14692412 ] Hadoop QA commented on YARN-4047: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3250) Support admin cli interface in for Application Priority

2015-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681416#comment-14681416 ] Hadoop QA commented on YARN-3250: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3964) Support NodeLabelsProvider at Resource Manager side

2015-08-11 Thread Dian Fu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated YARN-3964: -- Attachment: YARN-3964.002.patch Support NodeLabelsProvider at Resource Manager side

[jira] [Commented] (YARN-4037) Hadoop - failed redirect for container

2015-08-11 Thread Mohammad Shahid Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681316#comment-14681316 ] Mohammad Shahid Khan commented on YARN-4037: Hi Gagan, The below convention in

[jira] [Commented] (YARN-3924) Submitting an application to standby ResourceManager should respond better than Connection Refused

2015-08-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681526#comment-14681526 ] Rohith Sharma K S commented on YARN-3924: - If I see from user side, user would be

[jira] [Commented] (YARN-3964) Support NodeLabelsProvider at Resource Manager side

2015-08-11 Thread Dian Fu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681574#comment-14681574 ] Dian Fu commented on YARN-3964: --- Updated the patch with the following updates: - remove the

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-11 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681312#comment-14681312 ] Li Lu commented on YARN-3814: - Thank [~varun_saxena]! bq. So if GenericObjectMapper cannot

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-11 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681288#comment-14681288 ] Varun Saxena commented on YARN-3814: [~gtCarrera9], bq. Why we're not using if

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681649#comment-14681649 ] Hudson commented on YARN-3873: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1014 (See

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681650#comment-14681650 ] Hudson commented on YARN-3887: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1014 (See

[jira] [Commented] (YARN-3924) Submitting an application to standby ResourceManager should respond better than Connection Refused

2015-08-11 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681677#comment-14681677 ] Ajith S commented on YARN-3924: --- Hi [~rohithsharma] +1 and Thanks for the input, agree with

[jira] [Commented] (YARN-3964) Support NodeLabelsProvider at Resource Manager side

2015-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681778#comment-14681778 ] Hadoop QA commented on YARN-3964: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681644#comment-14681644 ] Hudson commented on YARN-3873: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #284 (See

[jira] [Commented] (YARN-3999) RM hangs on draing events

2015-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681583#comment-14681583 ] Hadoop QA commented on YARN-3999: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681645#comment-14681645 ] Hudson commented on YARN-3887: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #284 (See

[jira] [Commented] (YARN-3999) RM hangs on draing events

2015-08-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681691#comment-14681691 ] Rohith Sharma K S commented on YARN-3999: - Thanks [~jianhe] for updating the

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681702#comment-14681702 ] Sunil G commented on YARN-3873: --- Thank you very much [~leftnoteasy] for the review and

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681920#comment-14681920 ] Hudson commented on YARN-3887: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #281 (See

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681916#comment-14681916 ] Hudson commented on YARN-3873: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2230 (See

[jira] [Updated] (YARN-4037) Hadoop - failed redirect for container

2015-08-11 Thread Gagan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gagan updated YARN-4037: Attachment: mapred-site.xml yarn-site.xml Hi Mohammad, May be I am making a fundamental mistake.

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681917#comment-14681917 ] Hudson commented on YARN-3887: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2230 (See

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681964#comment-14681964 ] Hudson commented on YARN-3887: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2211 (See

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681998#comment-14681998 ] Hudson commented on YARN-3887: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #273 (See

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681997#comment-14681997 ] Hudson commented on YARN-3873: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #273 (See

[jira] [Commented] (YARN-3999) RM hangs on draing events

2015-08-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682011#comment-14682011 ] Jian He commented on YARN-3999: --- I talked to [~zjshen] about this too. I think it's fine as

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682044#comment-14682044 ] Junping Du commented on YARN-3212: -- Can someone give it a review? With this patch get in,

[jira] [Created] (YARN-4044) Running applications information changes such as movequeue is not published to TimeLine server

2015-08-11 Thread Sunil G (JIRA)
Sunil G created YARN-4044: - Summary: Running applications information changes such as movequeue is not published to TimeLine server Key: YARN-4044 URL: https://issues.apache.org/jira/browse/YARN-4044

[jira] [Commented] (YARN-4044) Running applications information changes such as movequeue is not published to TimeLine server

2015-08-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682033#comment-14682033 ] Sunil G commented on YARN-4044: --- Timeline v2 changes can be tracked in separate ticket once

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682082#comment-14682082 ] Sunil G commented on YARN-3212: --- Hi [~djp] I have one doubt in this. For

[jira] [Created] (YARN-4045) Negative avaialbleMB is being reported for root queue.

2015-08-11 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created YARN-4045: Summary: Negative avaialbleMB is being reported for root queue. Key: YARN-4045 URL: https://issues.apache.org/jira/browse/YARN-4045 Project: Hadoop YARN

[jira] [Commented] (YARN-4045) Negative avaialbleMB is being reported for root queue.

2015-08-11 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682118#comment-14682118 ] Rushabh S Shah commented on YARN-4045: -- bq. Thanks Rushabh S Shah for reporting this.

[jira] [Commented] (YARN-4023) Publish Application Priority to TimelineServer

2015-08-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682077#comment-14682077 ] Rohith Sharma K S commented on YARN-4023: - +1 for the latest patch, If no objection

[jira] [Commented] (YARN-3924) Submitting an application to standby ResourceManager should respond better than Connection Refused

2015-08-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682099#comment-14682099 ] Rohith Sharma K S commented on YARN-3924: - I agree with the concern that user

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682102#comment-14682102 ] Junping Du commented on YARN-3906: -- Thanks [~sjlee0] for the patch work and [~gtCarrera9]

[jira] [Commented] (YARN-4045) Negative avaialbleMB is being reported for root queue.

2015-08-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682110#comment-14682110 ] Sunil G commented on YARN-4045: --- Thanks [~shahrs87] for reporting this. One doubt, Which

[jira] [Commented] (YARN-3999) RM hangs on draing events

2015-08-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682112#comment-14682112 ] Rohith Sharma K S commented on YARN-3999: - thank [~jianhe] for the explanation.

[jira] [Commented] (YARN-4045) Negative avaialbleMB is being reported for root queue.

2015-08-11 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682115#comment-14682115 ] Thomas Graves commented on YARN-4045: - I remember seeing that this was fixed in

[jira] [Commented] (YARN-3979) Am in ResourceLocalizationService hang 10 min cause RM kill AM

2015-08-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682240#comment-14682240 ] Rohith Sharma K S commented on YARN-3979: - I had look at the RM logs shared, I

[jira] [Commented] (YARN-4046) Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST

2015-08-11 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682284#comment-14682284 ] Anubhav Dhoot commented on YARN-4046: - The error in NodeManager shows {noformat}

[jira] [Commented] (YARN-4046) Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST

2015-08-11 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682293#comment-14682293 ] Anubhav Dhoot commented on YARN-4046: - As per GNU linux

[jira] [Commented] (YARN-4023) Publish Application Priority to TimelineServer

2015-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682360#comment-14682360 ] Hadoop QA commented on YARN-4023: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (YARN-4046) NM container recovery is broken on some linux distro because of syntax of signal

2015-08-11 Thread Anubhav Dhoot (JIRA)
Anubhav Dhoot created YARN-4046: --- Summary: NM container recovery is broken on some linux distro because of syntax of signal Key: YARN-4046 URL: https://issues.apache.org/jira/browse/YARN-4046 Project:

[jira] [Updated] (YARN-4046) Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST

2015-08-11 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4046: Summary: Applications fail on NM restart on some linux distro because NM container recovery declares

[jira] [Assigned] (YARN-4047) ClientRMService getApplications has high scheduler lock contention

2015-08-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-4047: Assignee: Jason Lowe In OOZIE-1729 Oozie started calling getApplications to look for applications

[jira] [Updated] (YARN-4047) ClientRMService getApplications has high scheduler lock contention

2015-08-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-4047: -- Labels: 2.6.1-candidate (was: ) ClientRMService getApplications has high scheduler lock contention

[jira] [Created] (YARN-4047) ClientRMService getApplications has high scheduler lock contention

2015-08-11 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-4047: Summary: ClientRMService getApplications has high scheduler lock contention Key: YARN-4047 URL: https://issues.apache.org/jira/browse/YARN-4047 Project: Hadoop YARN

[jira] [Updated] (YARN-4047) ClientRMService getApplications has high scheduler lock contention

2015-08-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4047: - Attachment: YARN-4047.001.patch Patch that performs the checkAccess filter last rather than first.

[jira] [Commented] (YARN-2369) Environment variable handling assumes values should be appended

2015-08-11 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14682379#comment-14682379 ] Dustin Cote commented on YARN-2369: --- [~jlowe] thanks for all the input. I'll clean this

[jira] [Updated] (YARN-3999) RM hangs on draing events

2015-08-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3999: -- Attachment: (was: YARN-3999.5.patch) RM hangs on draing events -

[jira] [Updated] (YARN-3999) RM hangs on draing events

2015-08-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3999: -- Attachment: YARN-3999.5.patch RM hangs on draing events - Key:

[jira] [Updated] (YARN-4026) FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource requests

2015-08-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4026: - Attachment: YARN-4026.2.patch Thanks for comments [~jianhe], attached ver.2 patch. FiCaSchedulerApp:

[jira] [Updated] (YARN-2599) Standby RM should also expose some jmx and metrics

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2599: -- Target Version/s: 2.7.2, 2.6.2 (was: 2.6.1, 2.7.2) Standby RM should also expose some jmx and metrics

[jira] [Updated] (YARN-2506) TimelineClient should NOT be in yarn-common project

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2506: -- Target Version/s: 2.7.2, 2.6.2 (was: 2.6.1, 2.7.2) TimelineClient should NOT be in yarn-common project

[jira] [Updated] (YARN-2037) Add restart support for Unmanaged AMs

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2037: -- Target Version/s: 2.7.2, 2.6.2 (was: 2.6.1, 2.7.2) Add restart support for Unmanaged AMs

[jira] [Updated] (YARN-4046) Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST

2015-08-11 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4046: Attachment: YARN-4046.002.patch Fixed whitespace Applications fail on NM restart on some linux

[jira] [Updated] (YARN-3999) RM hangs on draing events

2015-08-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3999: -- Attachment: YARN-3999-branch-2.7.patch upload branch-2.7 patch RM hangs on draing events

[jira] [Updated] (YARN-3978) Configurably turn off the saving of container info in Generic AHS

2015-08-11 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-3978: -- Labels: 2.6.1-candidate (was: ) Configurably turn off the saving of container info in Generic AHS

[jira] [Commented] (YARN-2859) ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692916#comment-14692916 ] Sangjin Lee commented on YARN-2859: --- [~zjshen], can this be done for 2.6.1, or are you OK

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692511#comment-14692511 ] Vrushali C commented on YARN-4025: -- Yes, +1 Deal with byte representations of Longs in

[jira] [Updated] (YARN-1848) Persist ClusterMetrics across RM HA transitions

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1848: -- Target Version/s: 2.7.2, 2.6.2 (was: 2.6.1, 2.7.2) Persist ClusterMetrics across RM HA transitions

[jira] [Updated] (YARN-2014) Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2014: -- Target Version/s: 2.7.2, 2.6.2 (was: 2.6.1, 2.7.2) Performance: AM scaleability is 10% slower in 2.4

[jira] [Updated] (YARN-2055) Preemption: Jobs are failing due to AMs are getting launched and killed multiple times

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2055: -- Target Version/s: 2.7.2, 2.6.2 (was: 2.6.1, 2.7.2) Preemption: Jobs are failing due to AMs are getting

[jira] [Updated] (YARN-2457) FairScheduler: Handle preemption to help starved parent queues

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2457: -- Target Version/s: 2.7.2, 2.6.2 (was: 2.6.1, 2.7.2) FairScheduler: Handle preemption to help starved

[jira] [Updated] (YARN-1856) cgroups based memory monitoring for containers

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1856: -- Target Version/s: 2.7.2, 2.6.2 (was: 2.6.1, 2.7.2) cgroups based memory monitoring for containers

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692476#comment-14692476 ] Junping Du commented on YARN-3906: -- Ok. Committing this patch now. split the application

[jira] [Commented] (YARN-313) Add Admin API for supporting node resource configuration in command line

2015-08-11 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692632#comment-14692632 ] Inigo Goiri commented on YARN-313: -- Not critical, I think it can be deferred. I would

[jira] [Updated] (YARN-2038) Revisit how AMs learn of containers from previous attempts

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2038: -- Target Version/s: 2.7.2, 2.6.2 (was: 2.6.1, 2.7.2) Revisit how AMs learn of containers from previous

[jira] [Commented] (YARN-313) Add Admin API for supporting node resource configuration in command line

2015-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692843#comment-14692843 ] Hadoop QA commented on YARN-313: \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI list command

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1480: -- Target Version/s: 2.7.2, 2.6.2 (was: 2.6.1, 2.7.2) RM web services getApps() accepts many more filters

[jira] [Updated] (YARN-1681) When banned.users is not set in LCE's container-executor.cfg, submit job with user in DEFAULT_BANNED_USERS will receive unclear error message

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1681: -- Target Version/s: 2.7.2, 2.6.2 (was: 2.6.1, 2.7.2) When banned.users is not set in LCE's

[jira] [Updated] (YARN-1767) Windows: Allow a way for users to augment classpath of YARN daemons

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1767: -- Target Version/s: 2.7.2, 2.6.2 (was: 2.6.1, 2.7.2) Windows: Allow a way for users to augment classpath

[jira] [Commented] (YARN-4046) Applications fail on NM restart on some linux distro because NM container recovery declares AM container as LOST

2015-08-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692518#comment-14692518 ] Hadoop QA commented on YARN-4046: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-4026) FiCaSchedulerApp: ContainerAllocator should be able to choose how to order pending resource requests

2015-08-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4026: - Attachment: YARN-4026.3.patch Attached ver.3, added more comments and fixed findbugs warning.

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692468#comment-14692468 ] Sangjin Lee commented on YARN-4025: --- For the record, we will go ahead with YARN-3906

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692465#comment-14692465 ] Sangjin Lee commented on YARN-3906: --- I checked with [~vrushalic], and we decided to put

[jira] [Commented] (YARN-2014) Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692537#comment-14692537 ] Sangjin Lee commented on YARN-2014: --- Should this be targeted to 2.6.2? We're trying to

[jira] [Commented] (YARN-1848) Persist ClusterMetrics across RM HA transitions

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692541#comment-14692541 ] Sangjin Lee commented on YARN-1848: --- Should this be targeted to 2.6.2? We're trying to

[jira] [Commented] (YARN-1856) cgroups based memory monitoring for containers

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692538#comment-14692538 ] Sangjin Lee commented on YARN-1856: --- Should this be targeted to 2.6.2? We're trying to

[jira] [Commented] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI list command

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692545#comment-14692545 ] Sangjin Lee commented on YARN-1480: --- Should this be targeted to 2.6.2? We're trying to

[jira] [Commented] (YARN-313) Add Admin API for supporting node resource configuration in command line

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692546#comment-14692546 ] Sangjin Lee commented on YARN-313: -- Should this be targeted to 2.6.2? We're trying to

[jira] [Commented] (YARN-1767) Windows: Allow a way for users to augment classpath of YARN daemons

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692543#comment-14692543 ] Sangjin Lee commented on YARN-1767: --- Should this be targeted to 2.6.2? We're trying to

[jira] [Updated] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI list command

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1480: -- Unless the patch is ready to go and the JIRA is a critical fix, we'll defer it to 2.6.2. Let me know if you

[jira] [Updated] (YARN-2506) TimelineClient should NOT be in yarn-common project

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2506: -- Unless the patch is ready to go and the JIRA is a critical fix, we'll defer it to 2.6.2. Let me know if you

[jira] [Updated] (YARN-2599) Standby RM should also expose some jmx and metrics

2015-08-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2599: -- Unless the patch is ready to go and the JIRA is a critical fix, we'll defer it to 2.6.2. Let me know if you

  1   2   >