[jira] [Resolved] (YARN-4226) Make capacity scheduler queue's preemption status REST API consistent with GUI

[ https://issues.apache.org/jira/browse/YARN-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved YARN-4226. -- Resolution: Won't Fix Since the code works and is only slightly confusing, I am closing this ticket as

[jira] [Updated] (YARN-4461) Redundant nodeLocalityDelay log in LeafQueue

[ https://issues.apache.org/jira/browse/YARN-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4461: - Attachment: YARN-4461.001.patch [~jlowe], thank you for raising this issue. Would you mind looking at the

[jira] [Commented] (YARN-3769) Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027011#comment-15027011 ] Eric Payne commented on YARN-3769: -- bq. should this be backported to 2.6.x? [~sjlee0], I would recommend

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027020#comment-15027020 ] Eric Payne commented on YARN-4390: -- [~bikassaha], thank you for your comments. {quote} However, if YARN

[jira] [Created] (YARN-4390) Consider container request size during CS preemption

Eric Payne created YARN-4390: Summary: Consider container request size during CS preemption Key: YARN-4390 URL: https://issues.apache.org/jira/browse/YARN-4390 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025044#comment-15025044 ] Eric Payne commented on YARN-4390: -- One approach to alleviate this would be to add a buffer zone around

[jira] [Commented] (YARN-3769) Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032692#comment-15032692 ] Eric Payne commented on YARN-3769: -- [~sjlee0], Backport is in progress. Manual tests on 3-node cluster

[jira] [Commented] (YARN-3769) Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15029043#comment-15029043 ] Eric Payne commented on YARN-3769: -- bq. Could you check if the 2.7 commit applies cleanly to branch-2.6?

[jira] [Updated] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3769: - Attachment: YARN-3769-branch-2.7.006.patch [~leftnoteasy], thanks for your comments. {quote} The problem

[jira] [Updated] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3769: - Attachment: YARN-3769-branch-2.7.007.patch Attaching {{YARN-3769-branch-2.7.007.patch}}.

[jira] [Updated] (YARN-4225) Add preemption status to yarn queue -status for capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4225: - Attachment: YARN-4225.002.patch Attaching YARN-4225.002.patch I fixed

[jira] [Commented] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014488#comment-15014488 ] Eric Payne commented on YARN-3769: -- Thanks, [~leftnoteasy], but I'm not seeing failures in

[jira] [Commented] (YARN-4225) Add preemption status to yarn queue -status for capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014666#comment-15014666 ] Eric Payne commented on YARN-4225: -- All of the tests listed in the failure section above work for me in my

[jira] [Commented] (YARN-4225) Add preemption status to yarn queue -status for capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020621#comment-15020621 ] Eric Payne commented on YARN-4225: -- [~jlowe], Thanks for reviewing this patch and for your thoughtful

[jira] [Commented] (YARN-3769) Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021053#comment-15021053 ] Eric Payne commented on YARN-3769: -- [~leftnoteasy], Thank you very much! > Consider user limit when

[jira] [Commented] (YARN-4225) Add preemption status to yarn queue -status for capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022606#comment-15022606 ] Eric Payne commented on YARN-4225: -- bq. someone might call has when they should be calling get. Maybe a

[jira] [Commented] (YARN-4492) Add documentation for queue level preemption which is supported in Capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092901#comment-15092901 ] Eric Payne commented on YARN-4492: -- Thanks, [~Naganarasimha], for providing the documentation for this

[jira] [Commented] (YARN-4492) Add documentation for preemption supported in Capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094506#comment-15094506 ] Eric Payne commented on YARN-4492: -- Thanks for updating the patch so quickly, [~Naganarasimha]. I think it

[jira] [Commented] (YARN-4492) Add documentation for preemption supported in Capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094908#comment-15094908 ] Eric Payne commented on YARN-4492: -- Thanks [~Naganarasimha]. +1 (non-binding) > Add documentation for

[jira] [Updated] (YARN-2024) IOException in AppLogAggregatorImpl does not give stacktrace and leaves aggregated TFile in a bad state.

[ https://issues.apache.org/jira/browse/YARN-2024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2024: - Priority: Major (was: Critical) > IOException in AppLogAggregatorImpl does not give stacktrace and leaves

[jira] [Updated] (YARN-5069) TestFifoScheduler.testResourceOverCommit race condition

[ https://issues.apache.org/jira/browse/YARN-5069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5069: - Fix Version/s: (was: 2.7.4) 2.7.3 Changing Fix Version to 2.7.3 since branch 2.7.3

[jira] [Updated] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3362: - Fix Version/s: (was: 2.7.4) 2.7.3 Changing Fix Version to 2.7.3 since branch 2.7.3

[jira] [Updated] (YARN-5009) NMLeveldbStateStoreService database can grow substantially leading to longer recovery times

[ https://issues.apache.org/jira/browse/YARN-5009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5009: - Fix Version/s: (was: 2.7.4) 2.7.3 Changing Fix Version to 2.7.3 since branch 2.7.3

[jira] [Updated] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4751: - Fix Version/s: (was: 2.7.4) 2.7.3 Changing Fix Version to 2.7.3 since branch 2.7.3

[jira] [Updated] (YARN-5008) LeveldbRMStateStore database can grow substantially leading to long recovery times

[ https://issues.apache.org/jira/browse/YARN-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5008: - Fix Version/s: (was: 2.7.4) 2.7.3 > LeveldbRMStateStore database can grow

[jira] [Updated] (YARN-5008) LeveldbRMStateStore database can grow substantially leading to long recovery times

[ https://issues.apache.org/jira/browse/YARN-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5008: - Affects Version/s: (was: 2.7.0) 2.7.3 Changing Fix Version to 2.7.3 since

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300175#comment-15300175 ] Eric Payne commented on YARN-4751: -- Thanks [~Naganarasimha]! > In 2.7, Labeled queue usage not shown

[jira] [Updated] (YARN-4459) container-executor might kill process wrongly

[ https://issues.apache.org/jira/browse/YARN-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4459: - Assignee: Jun Gong (was: Eric Payne) > container-executor might kill process wrongly >

[jira] [Assigned] (YARN-4459) container-executor might kill process wrongly

[ https://issues.apache.org/jira/browse/YARN-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-4459: Assignee: Eric Payne (was: Jun Gong) > container-executor might kill process wrongly >

[jira] [Commented] (YARN-5116) Failed to execute "yarn application"

[ https://issues.apache.org/jira/browse/YARN-5116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300802#comment-15300802 ] Eric Payne commented on YARN-5116: -- Thanks, [~hex108], for reporting this issue and providing a patch. I

[jira] [Commented] (YARN-5116) Failed to execute "yarn application"

[ https://issues.apache.org/jira/browse/YARN-5116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302868#comment-15302868 ] Eric Payne commented on YARN-5116: -- Thanks [~sunilg] and [~aw] for your reviews. [~hex108], I will commit

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15102200#comment-15102200 ] Eric Payne commented on YARN-4108: -- [~leftnoteasy], thanks for your reply. {quote} bq. don't see anyplace

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15097113#comment-15097113 ] Eric Payne commented on YARN-4108: -- [~leftnoteasy], just a couple of quick things.

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15096538#comment-15096538 ] Eric Payne commented on YARN-2009: -- {quote} Sunil G, pardon the long delay... From what you say it seems

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15096540#comment-15096540 ] Eric Payne commented on YARN-2009: -- bq. And, of course, all of this will probably have to be re-evaluated

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15096620#comment-15096620 ] Eric Payne commented on YARN-2009: -- Thanks [~sunilg]. One more note is that YARN-2113 was also raised to

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098341#comment-15098341 ] Eric Payne commented on YARN-4108: -- bq. Do you have any comments/suggestions about the latest proposal?

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15099088#comment-15099088 ] Eric Payne commented on YARN-4108: -- [~leftnoteasy], great job! This approach looks like it has potential

[jira] [Updated] (YARN-3769) Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3769: - Attachment: YARN-3769-branch-2.6.002.patch bq. Hi Eric Payne, it looks like the patch for branch-2.6 has

[jira] [Commented] (YARN-1515) Provide ContainerManagementProtocol#signalContainer processing a batch of signals

[ https://issues.apache.org/jira/browse/YARN-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144578#comment-15144578 ] Eric Payne commented on YARN-1515: -- Sorry, I meant to post the above comment on MAPREDUCE-5044. Will go

[jira] [Commented] (YARN-1515) Provide ContainerManagementProtocol#signalContainer processing a batch of signals

[ https://issues.apache.org/jira/browse/YARN-1515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15143523#comment-15143523 ] Eric Payne commented on YARN-1515: -- Hi [~jira.shegalov]. I would like to see this functionality

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15127182#comment-15127182 ] Eric Payne commented on YARN-4108: -- Thanks [~leftnoteasy] for your work on the new patch,

[jira] [Commented] (YARN-3769) Consider user limit when calculating total pending resource for preemption policy in Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15131146#comment-15131146 ] Eric Payne commented on YARN-3769: -- Thanks [~djp]] I will look into it. > Consider user limit when

[jira] [Commented] (YARN-4481) negative pending resource of queues lead to applications in accepted status inifnitly

[ https://issues.apache.org/jira/browse/YARN-4481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15169550#comment-15169550 ] Eric Payne commented on YARN-4481: -- Not sure if this is related, but we are also seeing similar results in

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15111605#comment-15111605 ] Eric Payne commented on YARN-4108: -- Thanks for the updated patch, [~leftnoteasy]. I'm still working my

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174314#comment-15174314 ] Eric Payne commented on YARN-4751: -- Thanks, [~sunilg] for pointing out YARN-4304. I see that this revision

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189576#comment-15189576 ] Eric Payne commented on YARN-4686: -- [~ebadger], Thanks for working on a fix this issue. The patch is

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196270#comment-15196270 ] Eric Payne commented on YARN-4686: -- [~ebadger], thanks for updating this patch. Just one minor nit: In

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196551#comment-15196551 ] Eric Payne commented on YARN-4108: -- Thanks, [~leftnoteasy], for all of the great effort on this JIRA. This

[jira] [Updated] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4751: - Attachment: YARH-4752-branch-2.7.002.patch Attaching {{YARH-4752-branch-2.7.002.patch}}. It addresses some

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193832#comment-15193832 ] Eric Payne commented on YARN-4751: -- Thanks, [~sunilg]. I will look into trunk's version of

[jira] [Reopened] (YARN-4390) Consider container request size during CS preemption

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-4390: -- Assignee: Wangda Tan (was: Eric Payne) {quote} Since YARN-4108 doesn't solve all the issues. (I

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15215015#comment-15215015 ] Eric Payne commented on YARN-4751: -- Thank you very much, [~leftnoteasy]! {quote} 1) The ultimate solution

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218335#comment-15218335 ] Eric Payne commented on YARN-4751: -- [~leftnoteasy] / [~sunilg]: YARN-3362 (Add node label usage in RM

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15237578#comment-15237578 ] Eric Payne commented on YARN-2113: -- bq. I planned to work on YARN-4781 soon but I'm working on other

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235451#comment-15235451 ] Eric Payne commented on YARN-2113: -- [~vinodkv], have you had any chance to think about the implementation

[jira] [Updated] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4751: - Attachment: YARN-4751-branch-2.7.003.patch Thank you, [~leftnoteasy] and [~sunilg], for your reviews and

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235611#comment-15235611 ] Eric Payne commented on YARN-2113: -- {quote} Vinod Kumar Vavilapalli, have you had any chance to think

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198436#comment-15198436 ] Eric Payne commented on YARN-4108: -- Thanks, [~leftnoteasy]. The patch looks good to me. >

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15206963#comment-15206963 ] Eric Payne commented on YARN-4751: -- {quote} Yes, agreeing to the point that we have to aggregate and peek

[jira] [Commented] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210867#comment-15210867 ] Eric Payne commented on YARN-4117: -- [~giovanni.fumarola], thanks for bringing this to my attention.

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201886#comment-15201886 ] Eric Payne commented on YARN-4686: -- [~ebadger], Thanks for the work you have done resolving this issue. I

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15208653#comment-15208653 ] Eric Payne commented on YARN-4686: -- {quote} Hi Eric Badger and Eric Payne,

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198081#comment-15198081 ] Eric Payne commented on YARN-4686: -- Thanks, [~ebadger], for this patch. +1 LGTM. I will wait a day or so

[jira] [Updated] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4751: - Attachment: YARH-4752-branch-2.7.001.patch [~sunilg], perhaps we don't need the whole patch from

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15180687#comment-15180687 ] Eric Payne commented on YARN-4751: -- {quote} In that patch, I added one method in AbstractCSQueue named

[jira] [Created] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

Eric Payne created YARN-4751: Summary: In 2.7, Labeled queue usage not shown properly in capacity scheduler UI Key: YARN-4751 URL: https://issues.apache.org/jira/browse/YARN-4751 Project: Hadoop YARN

[jira] [Updated] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4751: - Attachment: 2.7 CS UI No BarGraph.jpg In the attached screenshot, please note that the {{Used Capacity}},

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15224433#comment-15224433 ] Eric Payne commented on YARN-4751: -- bq. As mentioned, we are not setting usedCapacity per label in 2.7 I

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253884#comment-15253884 ] Eric Payne commented on YARN-4390: -- {quote} And since it uses R/W lock, write lock will be acquired only

[jira] [Commented] (YARN-4556) TestFifoScheduler.testResourceOverCommit fails

[ https://issues.apache.org/jira/browse/YARN-4556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252732#comment-15252732 ] Eric Payne commented on YARN-4556: -- +1 > TestFifoScheduler.testResourceOverCommit fails >

[jira] [Updated] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4390: - Attachment: QueueNotHittingMax.jpg Hi [~leftnoteasy]. I have been testing YARN-4390.6.patch. I have tried

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264172#comment-15264172 ] Eric Payne commented on YARN-4390: -- [~leftnoteasy] bq. What's your idea about this case? Should we allow

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15264250#comment-15264250 ] Eric Payne commented on YARN-4390: -- [~jlowe] pointed out to me offline that it is probably not reserving

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15260985#comment-15260985 ] Eric Payne commented on YARN-4390: -- [~leftnoteasy], {quote} have you set following config? {code}

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252803#comment-15252803 ] Eric Payne commented on YARN-4390: -- Thanks, [~leftnoteasy], for the detailed work on this issue. Overall,

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15263164#comment-15263164 ] Eric Payne commented on YARN-4390: -- [~leftnoteasy], I am seeing kind of corner case in my testing of this

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15262659#comment-15262659 ] Eric Payne commented on YARN-3362: -- [~naganarasimha...@apache.org], is there any update? > Add node label

[jira] [Updated] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4751: - Attachment: YARN-4751-branch-2.7.005.patch Thanks, [~Naganarasimha]. You are correct, most of the findbugs

[jira] [Commented] (YARN-5069) TestFifoScheduler.testResourceOverCommit race condition

[ https://issues.apache.org/jira/browse/YARN-5069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15285244#comment-15285244 ] Eric Payne commented on YARN-5069: -- +1. Committing > TestFifoScheduler.testResourceOverCommit race

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15282689#comment-15282689 ] Eric Payne commented on YARN-3362: -- Thanks, [~naganarasimha...@apache.org]. Have you been able to look at

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15267205#comment-15267205 ] Eric Payne commented on YARN-3362: -- {noformat} Processing: YARN-3362 YARN-3362 patch is being downloaded

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15267203#comment-15267203 ] Eric Payne commented on YARN-3362: -- Thanks a lot, [~Naganarasimha]. I don't think the YARN pre-commit

[jira] [Updated] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3362: - Attachment: YARN-3362-branch-2.7.003.patch [~Naganarasimha]], uploading YARN-3362-branch-2.7.003.patch

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272503#comment-15272503 ] Eric Payne commented on YARN-4390: -- Sorry, [~leftnoteasy], for the delay. +1. LGTM (+) > Do surgical

[jira] [Commented] (YARN-4768) getAvailablePhysicalMemorySize can be inaccurate on linux

[ https://issues.apache.org/jira/browse/YARN-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15278366#comment-15278366 ] Eric Payne commented on YARN-4768: -- The fix LGTM. +1 > getAvailablePhysicalMemorySize can be inaccurate

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15266555#comment-15266555 ] Eric Payne commented on YARN-4390: -- bq. Long term solution should be fixing YARN-4280. Agreed. > Do

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242992#comment-15242992 ] Eric Payne commented on YARN-4751: -- bq. YARN-4751 does not apply to branch-2.7. Rebase required? Wrong

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241683#comment-15241683 ] Eric Payne commented on YARN-4945: -- Thanks [~leftnoteasy]. I have seen the following use case where

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241650#comment-15241650 ] Eric Payne commented on YARN-4751: -- {quote} f I understand correctly, what Sunil G suggested is,

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241898#comment-15241898 ] Eric Payne commented on YARN-4751: -- Thanks [~leftnoteasy], [~sunilg]. I think there are enough changes

[jira] [Updated] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3362: - Attachment: YARN-3362-branch-2.7.002.patch [~leftnoteasy] and [~sunilg], as we discussed in YARN-4751, I

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245610#comment-15245610 ] Eric Payne commented on YARN-3362: -- {quote} - When i submit a app to a queue with default node label

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245728#comment-15245728 ] Eric Payne commented on YARN-3362: -- {quote} After applying the patch then partition usage information

[jira] [Updated] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4751: - Attachment: YARN-4751-branch-2.7.004.patch [~leftnoteasy] / [~sunilg]. Thanks for your help on this issue.

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251820#comment-15251820 ] Eric Payne commented on YARN-3362: -- {quote} bq. If you think it would be cleaner, I can combine the

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240016#comment-15240016 ] Eric Payne commented on YARN-4751: -- Thanks for the suggestion [~sunilg]: bq. Is it better to have

[jira] [Commented] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240046#comment-15240046 ] Eric Payne commented on YARN-4751: -- bq. Is it better to have YARN-3362 2.7 version patch to be added in

[jira] [Updated] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3362: - Attachment: YARN-3362-branch-2.7.004.patch [~Naganarasimha], attaching YARN-3362-branch-2.7.004.patch with

[jira] [Commented] (YARN-4768) getAvailablePhysicalMemorySize can be inaccurate on linux

[ https://issues.apache.org/jira/browse/YARN-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276849#comment-15276849 ] Eric Payne commented on YARN-4768: -- bq. "Inactive(file)" would seem more accurate but it's not available

<    1   2   3   4   5   6   7   8   9   10   >