[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Description: Currently, in the capacity scheduler, the {{minimum-user-limit-percent}} property is per

[jira] [Updated] (YARN-4108) CapacityScheduler: Improve preemption to only kill containers that would satisfy the incoming request

[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4108: - Fix Version/s: 2.8.0 Thanks [~leftnoteasy] . I also backported this to branch-2.8 > CapacityScheduler:

[jira] [Commented] (YARN-2009) CapacityScheduler: Add intra-queue preemption for app priority support

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674334#comment-15674334 ] Eric Payne commented on YARN-2009: -- Hey [~leftnoteasy]. The fate of branch-2.8 is still up in the air, but

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15674342#comment-15674342 ] Eric Payne commented on YARN-5889: -- Thanks [~sunilg] and [~leftnoteasy] for the heads up. I will look at

[jira] [Commented] (YARN-4218) Metric for resource*time that was preempted

[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15625628#comment-15625628 ] Eric Payne commented on YARN-4218: -- [~lichangleo]. Sorry, I should have been more specific. Can you please

[jira] [Commented] (YARN-2009) CapacityScheduler: Add intra-queue preemption for app priority support

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15633578#comment-15633578 ] Eric Payne commented on YARN-2009: -- Hi [~leftnoteasy] and [~sunilg]. I would like this feature to be

[jira] [Commented] (YARN-2009) CapacityScheduler: Add intra-queue preemption for app priority support

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15633851#comment-15633851 ] Eric Payne commented on YARN-2009: -- Good point. There's no hurry, so we should wait for a few days to see

[jira] [Comment Edited] (YARN-4218) Metric for resource*time that was preempted

[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612427#comment-15612427 ] Eric Payne edited comment on YARN-4218 at 10/27/16 4:32 PM: Cancelling patch

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611992#comment-15611992 ] Eric Payne commented on YARN-2009: -- {quote} My suggestion is： commit existing patch, at least it works for

[jira] [Commented] (YARN-4218) Metric for resource*time that was preempted

[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622603#comment-15622603 ] Eric Payne commented on YARN-4218: -- [~lichangleo], sorry one more thing. I also noticed that the latest

[jira] [Commented] (YARN-4218) Metric for resource*time that was preempted

[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622586#comment-15622586 ] Eric Payne commented on YARN-4218: -- Thanks, [~lichangleo], for updating the patches. I'm looking into the

[jira] [Commented] (YARN-4218) Metric for resource*time that was preempted

[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15622971#comment-15622971 ] Eric Payne commented on YARN-4218: -- [~lichangleo], as for the trunk patch, please go ahead and fix the

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609848#comment-15609848 ] Eric Payne commented on YARN-2009: -- bq. there are cases where unnecessary preemption still happens. I have

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572765#comment-15572765 ] Eric Payne commented on YARN-2009: -- [~sunilg], do you plan on backporting this to branch-2/branch-2.8? >

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572955#comment-15572955 ] Eric Payne commented on YARN-2009: -- Thanks [~sunilg]. In order to backport YARN-2009 to 2.8, I think that

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572984#comment-15572984 ] Eric Payne commented on YARN-2009: -- [~sunilg], I think you may have missed my comment from

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576235#comment-15576235 ] Eric Payne commented on YARN-2009: -- [~sunilg], I have one concern about how

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15732320#comment-15732320 ] Eric Payne commented on YARN-5889: -- Thanks [~leftnoteasy]. I am still absorbing your previous comment, but

[jira] [Updated] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4390: - Attachment: YARN-4390.branch-2.8.003.patch Thanks [~leftnoteasy]. I've addressed the {{getMemorySize()}}

[jira] [Reopened] (YARN-2009) CapacityScheduler: Add intra-queue preemption for app priority support

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-2009: -- I'm backporting this to 2.8. Reopening so that I can put it back into patch available so it will kick a

[jira] [Updated] (YARN-2009) CapacityScheduler: Add intra-queue preemption for app priority support

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2009: - Attachment: YARN-2009.branch-2.8.001.patch > CapacityScheduler: Add intra-queue preemption for app

[jira] [Commented] (YARN-2009) CapacityScheduler: Add intra-queue preemption for app priority support

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745786#comment-15745786 ] Eric Payne commented on YARN-2009: -- Committing to branch-2.8. Thanks [~sunilg] and [~leftnoteasy] >

[jira] [Updated] (YARN-2009) CapacityScheduler: Add intra-queue preemption for app priority support

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2009: - Attachment: YARN-2009.branch-2.8.002.patch I noticed that findbugs is complaining about inconsistently

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725959#comment-15725959 ] Eric Payne commented on YARN-4390: -- The failing unit tests {{TestAMAuthorization, TestCapacityScheduler,

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15729021#comment-15729021 ] Eric Payne commented on YARN-4390: -- Unit tests TestAMAuthorization,

[jira] [Updated] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4390: - Attachment: YARN-4390.branch-2.8.002.patch Thanks [~leftnoteasy]. {quote} Thanks Eric Payne, if the

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748894#comment-15748894 ] Eric Payne commented on YARN-5889: -- bq. If we all agree this behavior (FIFO order comes before user

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15755181#comment-15755181 ] Eric Payne commented on YARN-5889: -- bq. I think in a busier and short-living app's cluster, we may

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736080#comment-15736080 ] Eric Payne commented on YARN-4390: -- {quote} bq. the patch LGTM except the javac warning: getMemory()

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812737#comment-15812737 ] Eric Payne commented on YARN-5889: -- [~sunilg], bq. However, I do think {{reComputeUserLimits}} needs to be

[jira] [Commented] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819338#comment-15819338 ] Eric Payne commented on YARN-6081: -- Thanks [~leftnoteasy] for fixing this. I am reviewing today. I will

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819482#comment-15819482 ] Eric Payne commented on YARN-5889: -- [~sunilg], - Shoule {{resetUserAddedOrRemoved}} just be

[jira] [Commented] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15819452#comment-15819452 ] Eric Payne commented on YARN-6081: -- +1 LGTM. The failed test ({{TestRMRestart}}) is not related to this

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712021#comment-15712021 ] Eric Payne commented on YARN-4390: -- Hi [~leftnoteasy], I am making an effort to backport to branch-2.8

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712097#comment-15712097 ] Eric Payne commented on YARN-5889: -- bq. Any change in resource (allocation and release of container etc)

[jira] [Comment Edited] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712097#comment-15712097 ] Eric Payne edited comment on YARN-5889 at 12/1/16 2:29 PM: --- bq. Any change in

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709832#comment-15709832 ] Eric Payne commented on YARN-5889: -- {quote} bq. It seems like this should be longer than 1 ms. It could be

[jira] [Updated] (YARN-4934) Reserved Resource for QueueMetrics needs to be handled correctly in few cases

[ https://issues.apache.org/jira/browse/YARN-4934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4934: - Fix Version/s: 2.8.0 I am backporting this to branch-2.8. It is a required prereq for YARN-4945,

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723438#comment-15723438 ] Eric Payne commented on YARN-4390: -- Thanks [~leftnoteasy]. I think I have it figured out. This JIRA

[jira] [Updated] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4390: - Attachment: YARN-4390.branch-2.8.001.patch > Do surgical preemption based on reserved container in

[jira] [Reopened] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-4390: -- The backport to 2.8 was a little tricky. I would like to reopen this JIRA, attach the 2.8 patch, and move

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15715787#comment-15715787 ] Eric Payne commented on YARN-4390: -- [~leftnoteasy], It looks like YARN-4865 is also needed as a prereq to

[jira] [Updated] (YARN-4865) Track Reserved resources in ResourceUsage and QueueCapacities

[ https://issues.apache.org/jira/browse/YARN-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4865: - Fix Version/s: 2.8.0 I am backporting this to branch-2.8. It is a require prereq for YARN-4945,

[jira] [Commented] (YARN-5864) YARN Capacity Scheduler - Queue Priorities

[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799610#comment-15799610 ] Eric Payne commented on YARN-5864: -- Thanks [~leftnoteasy] for the design doc. It makes sense, and I just

[jira] [Updated] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5889: - Attachment: YARN-5889.0001.suggested.patchnotes Thanks [~sunilg] for providing this work. I am concerned

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812251#comment-15812251 ] Eric Payne commented on YARN-5889: -- Thanks [~leftnoteasy] for your review and comments. bq. If everybody

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812128#comment-15812128 ] Eric Payne commented on YARN-5889: -- bq. Since number of active users are changed, we need to recalculate

[jira] [Created] (YARN-5973) TestCapacitySchedulerSurgicalPreemption sometimes fails

Eric Payne created YARN-5973: Summary: TestCapacitySchedulerSurgicalPreemption sometimes fails Key: YARN-5973 URL: https://issues.apache.org/jira/browse/YARN-5973 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939235#comment-15939235 ] Eric Payne commented on YARN-5892: -- Thanks for your comments, [~sunilg]. bq. Is it possible to keep

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.006.patch Thanks for your helpful comments [~leftnoteasy] and [~sunilg]. I am

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941759#comment-15941759 ] Eric Payne commented on YARN-2113: -- bq. as of now, YARN doesn't calculate UL for different priorities, but

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: TestNoIntraQueuePreemptionIfBelowUserLimitAndDifferentPrioritiesWithExtraUsers.txt > Add

[jira] [Commented] (YARN-6354) LeveldbRMStateStore can parse invalid keys when recovering reservations

[ https://issues.apache.org/jira/browse/YARN-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951352#comment-15951352 ] Eric Payne commented on YARN-6354: -- +1. Thanks [~jlowe]. I will merge to trunk, branch-2, and branch-2.8.

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930339#comment-15930339 ] Eric Payne commented on YARN-2113: -- Hi [~sunilg]. Thanks for this patch. I'm excited to look at it. There

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.005.patch The previous patch ({{004}}) only updated users' weights when each user

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.004.patch Attaching new patch to address findbugs/checkstyle/compile/mvnsite issues.

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925012#comment-15925012 ] Eric Payne commented on YARN-5892: -- Thanks a lot, [~leftnoteasy], for your comments. bq. 1) Can this patch

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.007.patch [~leftnoteasy], Attaching a YARN-5892.007.patch, that addresses all of

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953639#comment-15953639 ] Eric Payne commented on YARN-5892: -- Thanks [~leftnoteasy] for your detailed review. I really appreciate

[jira] [Commented] (YARN-6450) TestContainerManagerWithLCE requires override for each new test added to ContainerManagerTest

[ https://issues.apache.org/jira/browse/YARN-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965941#comment-15965941 ] Eric Payne commented on YARN-6450: -- Thanks [~jlowe]. The patch LGTM. +1. Will commit shortly. >

[jira] [Commented] (YARN-5617) AMs only intended to run one attempt can be run more than once

[ https://issues.apache.org/jira/browse/YARN-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965826#comment-15965826 ] Eric Payne commented on YARN-5617: -- [~jlowe], thanks for raising this issue and supplying the patches.

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.009.patch Thanks [~sunilg] for your comments. bq. 1.

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956944#comment-15956944 ] Eric Payne commented on YARN-5892: -- Build failure seems unrelated: {noformat} [ERROR] Failed to execute

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962745#comment-15962745 ] Eric Payne commented on YARN-5892: -- {quote} ||*User Name*||*Max Resource*||*Weight*||*Used Resource*||

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.008.patch There are a couple of notable things about this patch: - A user's weight

[jira] [Comment Edited] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966789#comment-15966789 ] Eric Payne edited comment on YARN-5892 at 4/12/17 11:10 PM: By the way, the

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966789#comment-15966789 ] Eric Payne commented on YARN-5892: -- By the way, the latest patch reverts the behavior of what is displayed

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971041#comment-15971041 ] Eric Payne commented on YARN-5892: -- Thanks a lot [~sunilg] for your review and comments. {quote} {code}

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971108#comment-15971108 ] Eric Payne commented on YARN-5892: -- bq. Yes, we could discuss more about the definition in separate jira.

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974722#comment-15974722 ] Eric Payne commented on YARN-2113: -- bq. So I don't see the need for ... checking something with the

[jira] [Commented] (YARN-5994) TestCapacityScheduler.testAMLimitUsage fails intermittently

[ https://issues.apache.org/jira/browse/YARN-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969087#comment-15969087 ] Eric Payne commented on YARN-5994: -- Thanks [~ebadger] for reporting and fixing this issue. The only thing

[jira] [Commented] (YARN-5617) AMs only intended to run one attempt can be run more than once

[ https://issues.apache.org/jira/browse/YARN-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15977046#comment-15977046 ] Eric Payne commented on YARN-5617: -- The patch LGTM, [~jlowe]. +1 bq. Also pinging [~jianhe] and

[jira] [Comment Edited] (YARN-5994) TestCapacityScheduler.testAMLimitUsage fails intermittently

[ https://issues.apache.org/jira/browse/YARN-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969087#comment-15969087 ] Eric Payne edited comment on YARN-5994 at 4/14/17 4:19 PM: --- Thanks [~ebadger] for

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974620#comment-15974620 ] Eric Payne commented on YARN-2113: -- [~sunilg] / [~jlowe], I don't think we should make this too

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.010.patch Thanks again [~leftnoteasy], [~sunilg], and [~jlowe]. I am uploading a

[jira] [Commented] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

[ https://issues.apache.org/jira/browse/YARN-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903349#comment-15903349 ] Eric Payne commented on YARN-6165: -- Thanks Jason and Sunil. > Intra-queue preemption occurs even when

[jira] [Updated] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

[ https://issues.apache.org/jira/browse/YARN-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6165: - Attachment: YARN-6165.001.patch {{IntraQueueCandidatesSelector#selectCandidates}} was not checking the

[jira] [Commented] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

[ https://issues.apache.org/jira/browse/YARN-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901921#comment-15901921 ] Eric Payne commented on YARN-6165: -- bq. this needs a Jenkins run anyway Thanks [~jlowe]. I kicked the

[jira] [Commented] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

[ https://issues.apache.org/jira/browse/YARN-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15901886#comment-15901886 ] Eric Payne commented on YARN-6165: -- bq. I think patch looks fine for me. Thanks [~sunilg]. Will you be

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: Active users highlighted.jpg > Capacity Scheduler: Support user-specific minimum user limit

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.003.patch Thanks [~leftnoteasy] and [~sunilg] for the reviews and valuable feedback.

[jira] [Commented] (YARN-6248) user is not removed from UsersManager’s when app is killed with pending container requests.

[ https://issues.apache.org/jira/browse/YARN-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896002#comment-15896002 ] Eric Payne commented on YARN-6248: -- Thank you [~sunilg] > user is not removed from UsersManager’s when

[jira] [Commented] (YARN-6248) Killing an app with pending container requests leaves the user in UsersManager

[ https://issues.apache.org/jira/browse/YARN-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15894464#comment-15894464 ] Eric Payne commented on YARN-6248: -- bq. yes. looks fine. if there are no other major concerns, i cud help

[jira] [Updated] (YARN-6248) Killing an app with pending container requests leaves the user in UsersManager

[ https://issues.apache.org/jira/browse/YARN-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6248: - Attachment: YARN-6248.001.patch Uploading patch. [~sunilg] and [~leftnoteasy], can you please have a look?

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951222#comment-15951222 ] Eric Payne commented on YARN-2113: -- Thanks [~sunilg] for the updated patch. It looks good in gneral, but I

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15961235#comment-15961235 ] Eric Payne commented on YARN-2113: -- Thanks [~sunilg] for the update. I am still reviewing the patch, but I

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971588#comment-15971588 ] Eric Payne commented on YARN-5892: -- {quote} Having 0 as a user weight doesn't hurt anything except the

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971707#comment-15971707 ] Eric Payne commented on YARN-2113: -- [~leftnoteasy], it looks good in general, but I did discover a corner

[jira] [Comment Edited] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15971707#comment-15971707 ] Eric Payne edited comment on YARN-2113 at 4/17/17 9:58 PM: --- [~leftnoteasy], it

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15972782#comment-15972782 ] Eric Payne commented on YARN-5892: -- [~leftnoteasy], thank you very much for your in-depth review and

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15973473#comment-15973473 ] Eric Payne commented on YARN-2113: -- bq. this is a valid corner case to me, ... I suggest to move it to a

[jira] [Commented] (YARN-5617) AMs only intended to run one attempt can be run more than once

[ https://issues.apache.org/jira/browse/YARN-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981542#comment-15981542 ] Eric Payne commented on YARN-5617: -- Thanks, [~jlowe]. I committed this patch to trunk and branch 2.

[jira] [Commented] (YARN-6901) A CapacityScheduler app->LeafQueue deadlock found in branch-2.8

[ https://issues.apache.org/jira/browse/YARN-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107433#comment-16107433 ] Eric Payne commented on YARN-6901: -- [~leftnoteasy], thanks for the heads-up on this issue. bq. I have yet

[jira] [Commented] (YARN-6901) A CapacityScheduler app->LeafQueue deadlock found in branch-2.8

[ https://issues.apache.org/jira/browse/YARN-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107522#comment-16107522 ] Eric Payne commented on YARN-6901: -- I suspect the test failure is a recurring one: YARN-5973 > A

[jira] [Commented] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

[ https://issues.apache.org/jira/browse/YARN-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110852#comment-16110852 ] Eric Payne commented on YARN-6846: -- {quote} these aren't the methods that are setting errno in the code

[jira] [Assigned] (YARN-6917) Queue path is recomputed from scratch on every allocation

[ https://issues.apache.org/jira/browse/YARN-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-6917: Assignee: Eric Payne > Queue path is recomputed from scratch on every allocation >

[jira] [Commented] (YARN-6846) Nodemanager can fail to fully delete application local directories when applications are killed

[ https://issues.apache.org/jira/browse/YARN-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109883#comment-16109883 ] Eric Payne commented on YARN-6846: -- The patch looks good in general, but there is one thing I'd like to

[jira] [Commented] (YARN-7017) Enable preemption for a single queue.

[ https://issues.apache.org/jira/browse/YARN-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127774#comment-16127774 ] Eric Payne commented on YARN-7017: -- Thanks [~saruntek] for raising this issue. {quote} As of today the

[jira] [Comment Edited] (YARN-7017) Enable preemption for a single queue.

[ https://issues.apache.org/jira/browse/YARN-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127774#comment-16127774 ] Eric Payne edited comment on YARN-7017 at 8/15/17 7:56 PM: --- Thanks [~saruntek]

[jira] [Updated] (YARN-6917) Queue path is recomputed from scratch on every allocation

[ https://issues.apache.org/jira/browse/YARN-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6917: - Attachment: YARN-6917.002.patch Thanks [~jlowe]. Uploading patch YARN-6917.002.patch that makes {{String

<    1   2   3   4   5   6   7   8   9   10   >