[jira] [Commented] (YARN-4459) container-executor might kill process wrongly

[ https://issues.apache.org/jira/browse/YARN-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15300266#comment-15300266 ] Eric Payne commented on YARN-4459: -- Thanks [~hex108] for the fix and [~jlowe] for the update and reveiw.

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15389828#comment-15389828 ] Eric Payne commented on YARN-4945: -- HI [~leftnoteasy]. Sorry for the long delay. I am now starting to have

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392184#comment-15392184 ] Eric Payne commented on YARN-4945: -- Thanks [~sunilg]. I appreciate very much any design help and POC help

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392303#comment-15392303 ] Eric Payne commented on YARN-4945: -- {quote} This is considering priority of apps alone. Yes, we have to

[jira] [Commented] (YARN-4091) Add REST API to retrieve scheduler activity

[ https://issues.apache.org/jira/browse/YARN-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402492#comment-15402492 ] Eric Payne commented on YARN-4091: -- [~ChenGe], thank you for your work on this feature. I am sorry for the

[jira] [Commented] (YARN-4091) Add REST API to retrieve scheduler activity

[ https://issues.apache.org/jira/browse/YARN-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409976#comment-15409976 ] Eric Payne commented on YARN-4091: -- bq. Any other suggestions? Sunil G / Eric Payne. Latest patch LGTM +1.

[jira] [Commented] (YARN-4091) Add REST API to retrieve scheduler activity

[ https://issues.apache.org/jira/browse/YARN-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402932#comment-15402932 ] Eric Payne commented on YARN-4091: -- Thanks, [~leftnoteasy], for the helpful explanation. I see now that

[jira] [Moved] (YARN-5469) Increase timeout of TestAmFilter.testFilter

[ https://issues.apache.org/jira/browse/YARN-5469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne moved HADOOP-13462 to YARN-5469: --- Key: YARN-5469 (was: HADOOP-13462) Project: Hadoop YARN (was: Hadoop

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852243#comment-15852243 ] Eric Payne commented on YARN-5889: -- Thanks [~sunilg] and [~leftnoteasy] for your work on this feature. I

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15855123#comment-15855123 ] Eric Payne commented on YARN-5889: -- OK. Latest patch looks good. [~sunilg], [~leftnoteasy], are you

[jira] [Commented] (YARN-6152) Used queue percentage not accurate in UI for 2.7 and below when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-6152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856203#comment-15856203 ] Eric Payne commented on YARN-6152: -- Thanks [~jhung], I will review today. > Used queue percentage not

[jira] [Updated] (YARN-6152) Used queue percentage not accurate in UI for 2.7 and below when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-6152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6152: - Fix Version/s: 2.7.4 > Used queue percentage not accurate in UI for 2.7 and below when using >

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856400#comment-15856400 ] Eric Payne commented on YARN-5889: -- [~leftnoteasy] bq. Since we're close to 2.8 release now, let's try to

[jira] [Commented] (YARN-6152) Used queue percentage not accurate in UI for 2.7 and below when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-6152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856365#comment-15856365 ] Eric Payne commented on YARN-6152: -- The patch LGTM. +1 The unit test failures are unrelated. > Used

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15854640#comment-15854640 ] Eric Payne commented on YARN-5889: -- [~sunilg], Thanks for running those manual tests. Those were the same

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852845#comment-15852845 ] Eric Payne commented on YARN-5889: -- bq. resources are not recorded for that user about half the

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836712#comment-15836712 ] Eric Payne commented on YARN-5889: -- bq. LQ#allocateResource will invoke UM#User#assignContainer. So all

[jira] [Assigned] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-5892: Assignee: Eric Payne > Capacity Scheduler: Support user-specific minimum user limit percent >

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.002.patch Uploading new patch to address the javadoc and findbug warnings. I also

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882720#comment-15882720 ] Eric Payne commented on YARN-5892: -- Thanks, [~leftnoteasy], for your feedback. I really value your input.

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Attachment: YARN-5892.001.patch Attaching first draft of the patch. I still need to make the

[jira] [Created] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

Eric Payne created YARN-6165: Summary: Intra-queue preemption occurs even when preemption is turned off for a specific queue. Key: YARN-6165 URL: https://issues.apache.org/jira/browse/YARN-6165 Project:

[jira] [Assigned] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

[ https://issues.apache.org/jira/browse/YARN-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-6165: Assignee: Eric Payne > Intra-queue preemption occurs even when preemption is turned off for a >

[jira] [Commented] (YARN-6165) Intra-queue preemption occurs even when preemption is turned off for a specific queue.

[ https://issues.apache.org/jira/browse/YARN-6165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15859987#comment-15859987 ] Eric Payne commented on YARN-6165: -- Use Case: - Configure queues with cluster-wide preemption on, but a

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829005#comment-15829005 ] Eric Payne commented on YARN-5889: -- [~leftnoteasy] and [~sunilg], I'm sorry for coming back to this point,

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15830384#comment-15830384 ] Eric Payne commented on YARN-5889: -- bq. the user limit resource is never calculated to be more than

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832068#comment-15832068 ] Eric Payne commented on YARN-5889: -- bq. it never gets above {{queue-capacity * MULP}} [~sunilg] and

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15830149#comment-15830149 ] Eric Payne commented on YARN-5889: -- [~leftnoteasy], the crux of the problem is that if MULP is less than

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428904#comment-15428904 ] Eric Payne commented on YARN-4945: -- [~sunilg], thank you so much for providing this design doc and POC. I

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431513#comment-15431513 ] Eric Payne commented on YARN-4945: -- [~sunilg], Thanks a lot for your reply! {quote} - user-limit: may be

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15891256#comment-15891256 ] Eric Payne commented on YARN-5892: -- {quote} So I preferred to keep the semantic more similar to existing

[jira] [Created] (YARN-6248) Killing an app with pending container requests leaves the user in UsersManager

Eric Payne created YARN-6248: Summary: Killing an app with pending container requests leaves the user in UsersManager Key: YARN-6248 URL: https://issues.apache.org/jira/browse/YARN-6248 Project: Hadoop

[jira] [Updated] (YARN-6248) Killing an app with pending container requests leaves the user in UsersManager

[ https://issues.apache.org/jira/browse/YARN-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6248: - Attachment: User Left Over.jpg > Killing an app with pending container requests leaves the user in

[jira] [Commented] (YARN-6248) Killing an app with pending container requests leaves the user in UsersManager

[ https://issues.apache.org/jira/browse/YARN-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890386#comment-15890386 ] Eric Payne commented on YARN-6248: -- The above Unit tests

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458695#comment-15458695 ] Eric Payne commented on YARN-4945: -- [~sunilg], just one quick note: I am getting a

[jira] [Commented] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15461859#comment-15461859 ] Eric Payne commented on YARN-: -- Thank you very much, [~vvasudev], for the review and the commit. >

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465592#comment-15465592 ] Eric Payne commented on YARN-4945: -- [~leftnoteasy] and [~sunilg], bq. Using logic similar to

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468165#comment-15468165 ] Eric Payne commented on YARN-4945: -- Thanks [~sunilg]. {quote} bq. if it's already in selectedCandidates,

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455570#comment-15455570 ] Eric Payne commented on YARN-4945: -- Thanks very much [~sunilg] and [~leftnoteasy]. {quote} 1. I think we

[jira] [Assigned] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-: Assignee: Eric Payne > Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically >

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472191#comment-15472191 ] Eric Payne commented on YARN-4945: -- Thank you [~leftnoteasy]. I see now that

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472235#comment-15472235 ] Eric Payne commented on YARN-4945: -- [~sunilg], thanks again for all of the great work you are doing on

[jira] [Updated] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-: - Attachment: YARN-.001.patch > Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478391#comment-15478391 ] Eric Payne commented on YARN-4945: -- Thanks [~sunilg]. I have a few review comments for patch v0: -

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488403#comment-15488403 ] Eric Payne commented on YARN-4945: -- bq. Does this make sense? [~sunilg], Thanks for the reply. Yes. I was

[jira] [Updated] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-: - Fix Version/s: (was: 3.0.0-alpha2) (was: 2.9.0) 2.8.0 Thanks

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15493893#comment-15493893 ] Eric Payne commented on YARN-4945: -- Thanks again, [~sunilg]. I will look closely at the patch, but one

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15495060#comment-15495060 ] Eric Payne commented on YARN-4945: -- [~sunilg], I noticed in the resourcemanager log that the metrics were

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15550216#comment-15550216 ] Eric Payne commented on YARN-2009: -- Thanks, [~sunilg], for the new patch. Preemption for the purposes of

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553303#comment-15553303 ] Eric Payne commented on YARN-2009: -- Thanks, [~sunilg], for your reply. - -

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15562302#comment-15562302 ] Eric Payne commented on YARN-2009: -- Thanks for all the work [~sunilg] and [~leftnoteasy] have put into

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15494394#comment-15494394 ] Eric Payne commented on YARN-4945: -- bq. I would say it may not be necessarily to have two separate

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497037#comment-15497037 ] Eric Payne commented on YARN-4945: -- [~leftnoteasy] bq. Have a Map of username to headroom inside the

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503934#comment-15503934 ] Eric Payne commented on YARN-2009: -- [~sunilg], Thanks for providing YARN-2009.0001.patch. Unfortunately,

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504007#comment-15504007 ] Eric Payne commented on YARN-2009: -- [~sunilg], please note that your patch depends on

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15516923#comment-15516923 ] Eric Payne commented on YARN-2009: -- {quote} I also thought about this in similar lines. But there was one

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514480#comment-15514480 ] Eric Payne commented on YARN-2009: -- [~leftnoteasy], Thanks. I missed that. > Priority support for

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511394#comment-15511394 ] Eric Payne commented on YARN-2009: -- -

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513725#comment-15513725 ] Eric Payne commented on YARN-2009: -- [~leftnoteasy], I have some concerns about this algorithm from above:

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514393#comment-15514393 ] Eric Payne commented on YARN-2009: -- bq. So we could take a max(guaranteed, used). Will this be fine? I

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507326#comment-15507326 ] Eric Payne commented on YARN-2009: -- [~leftnoteasy], I am confused by your above example: {quote} Queue's

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507832#comment-15507832 ] Eric Payne commented on YARN-2009: -- {quote} In my above example, the #active_users is 2 instead of 3

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499359#comment-15499359 ] Eric Payne commented on YARN-4945: -- [~sunilg], I'm afraid I gave you bad advice [in my comment

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504876#comment-15504876 ] Eric Payne commented on YARN-2009: -- [~sunilg] / [~leftnoteasy] I am still in the middle of reviewing the

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471536#comment-15471536 ] Eric Payne commented on YARN-4945: -- [~leftnoteasy] and [~sunilg], I'm still concerned about having the

[jira] [Commented] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471662#comment-15471662 ] Eric Payne commented on YARN-: -- Any objections if I backport this to branch-2.8? > Scheduler UI: "%

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439148#comment-15439148 ] Eric Payne commented on YARN-4945: -- [~sunilg] and [~leftnoteasy], While I was writing the use cases, I

[jira] [Updated] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-: - Attachment: PctOfQueueIsInaccurate.jpg The queue structure for the attached screenshot

[jira] [Updated] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-: - Assignee: (was: Eric Payne) > Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically

[jira] [Created] (YARN-5555) Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested.

Eric Payne created YARN-: Summary: Scheduler UI: "% of Queue" is inaccurate if leaf queue is hierarchically nested. Key: YARN- URL: https://issues.apache.org/jira/browse/YARN- Project: Hadoop

[jira] [Updated] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4945: - Attachment: Intra-Queue Preemption Use Cases.pdf [~sunilg] and [~leftnoteasy], I am attaching the set of

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543523#comment-15543523 ] Eric Payne commented on YARN-2009: -- Hi [~sunilg], I noticed some odd behavior while trying the following

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15520009#comment-15520009 ] Eric Payne commented on YARN-2009: -- Hi [~sunilg]. After thinking more about it, I think I would like to

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609030#comment-15609030 ] Eric Payne commented on YARN-2009: -- [~sunilg], I am still analyzing the code, but I do want to point out

[jira] [Updated] (YARN-5725) Test uncaught exception in TestContainersMonitorResourceChange.testContainersResourceChange when setting IP and host

[ https://issues.apache.org/jira/browse/YARN-5725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5725: - Component/s: nodemanager > Test uncaught exception in >

[jira] [Updated] (YARN-5311) Document graceful decommission CLI and usage

[ https://issues.apache.org/jira/browse/YARN-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5311: - Labels: oct16-easy (was: ) > Document graceful decommission CLI and usage >

[jira] [Updated] (YARN-5271) ATS client doesn't work with Jersey 2 on the classpath

[ https://issues.apache.org/jira/browse/YARN-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5271: - Labels: oct16-medium (was: ) > ATS client doesn't work with Jersey 2 on the classpath >

[jira] [Updated] (YARN-4218) Metric for resource*time that was preempted

[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4218: - Component/s: resourcemanager > Metric for resource*time that was preempted >

[jira] [Updated] (YARN-5773) RM recovery too slow due to LeafQueue#activateApplication()

[ https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5773: - Component/s: rolling upgrade capacity scheduler > RM recovery too slow due to

[jira] [Updated] (YARN-5369) Improve Yarn logs command to get container logs based on Node Id

[ https://issues.apache.org/jira/browse/YARN-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5369: - Labels: oct16-medium (was: ) Component/s: yarn client > Improve Yarn logs

[jira] [Updated] (YARN-5725) Test uncaught exception in TestContainersMonitorResourceChange.testContainersResourceChange when setting IP and host

[ https://issues.apache.org/jira/browse/YARN-5725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5725: - Labels: oct16-easy (was: ) > Test uncaught exception in >

[jira] [Updated] (YARN-5773) RM recovery too slow due to LeafQueue#activateApplication()

[ https://issues.apache.org/jira/browse/YARN-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5773: - Labels: oct16-medium (was: ) > RM recovery too slow due to LeafQueue#activateApplication() >

[jira] [Updated] (YARN-5706) Fail to launch SLSRunner due to NPE

[ https://issues.apache.org/jira/browse/YARN-5706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5706: - Labels: oct16-easy (was: ) Component/s: scheduler-load-simulator > Fail to launch SLSRunner due

[jira] [Updated] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5554: - Labels: oct16-medium (was: ) > MoveApplicationAcrossQueues does not check user permission on the target

[jira] [Updated] (YARN-5435) [Regression] QueueCapacities not being updated for dynamic ReservationQueue

[ https://issues.apache.org/jira/browse/YARN-5435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5435: - Labels: oct16-easy regression (was: regression) > [Regression] QueueCapacities not being updated for

[jira] [Updated] (YARN-5602) Utils for Federation State and Policy Store

[ https://issues.apache.org/jira/browse/YARN-5602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5602: - Labels: oct16-medium (was: ) > Utils for Federation State and Policy Store >

[jira] [Commented] (YARN-2009) Intra-queue preemption for app priority support ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613181#comment-15613181 ] Eric Payne commented on YARN-2009: -- The latest patch LGTM, as long as we commit it with the understanding

[jira] [Commented] (YARN-5602) Utils for Federation State and Policy Store

[ https://issues.apache.org/jira/browse/YARN-5602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613363#comment-15613363 ] Eric Payne commented on YARN-5602: -- Hi [~giovanni.fumarola]. Thanks for working on the fix for this issue.

[jira] [Commented] (YARN-4218) Metric for resource*time that was preempted

[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616696#comment-15616696 ] Eric Payne commented on YARN-4218: -- [~lichangleo], Thank you very much for adding this useful metric. I'm

[jira] [Commented] (YARN-4218) Metric for resource*time that was preempted

[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655289#comment-15655289 ] Eric Payne commented on YARN-4218: -- +1 Thanks [~lichangleo] for the patches and the work done on this

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589980#comment-15589980 ] Eric Payne commented on YARN-2009: -- [~sunilg], thanks for the updated patch. There is a problem with

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576735#comment-15576735 ] Eric Payne commented on YARN-2009: -- Hi [~sunilg]. I think I would suggest to do the following:

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592740#comment-15592740 ] Eric Payne commented on YARN-2009: -- Hi [~sunilg]. Here is a description of my test environment, the steps

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593001#comment-15593001 ] Eric Payne commented on YARN-2009: -- Hi [~sunilg]. I am confused by something you said in the [comment

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15594971#comment-15594971 ] Eric Payne commented on YARN-2009: -- bq. the test code which i posted was from my unit test Thanks

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583579#comment-15583579 ] Eric Payne commented on YARN-2009: -- Thanks for the updated patch [~sunilg]. Should this feature work with

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687948#comment-15687948 ] Eric Payne commented on YARN-5889: -- Thanks [~sunilg] for working on this refactoring. Here are my comments

[jira] [Updated] (YARN-4822) Refactor existing Preemption Policy of CS for easier adding new approach to select preemption candidates

[ https://issues.apache.org/jira/browse/YARN-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4822: - Fix Version/s: 2.8.0 Thanks [~leftnoteasy]. I also backported this to branch-2.8 > Refactor existing

[jira] [Moved] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne moved MAPREDUCE-6812 to YARN-5892: - Component/s: (was: yarn) (was: capacity-sched)

[jira] [Updated] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-5892: - Component/s: (was: capacity scheduler) (was: yarn)

<    1   2   3   4   5   6   7   8   9   10   >