[jira] [Commented] (YARN-9019) Ratio calculation of ResourceCalculator implementations could return NaN

2022-09-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17600907#comment-17600907 ] Eric Payne commented on YARN-9019: -- I backported this to branch-3.2 and branch-2.10 > Ratio calculation

[jira] [Updated] (YARN-9019) Ratio calculation of ResourceCalculator implementations could return NaN

2022-09-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9019: - Fix Version/s: 2.10.3 3.2.5 > Ratio calculation of ResourceCalculator implementations

[jira] [Commented] (YARN-9019) Ratio calculation of ResourceCalculator implementations could return NaN

2022-09-01 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17599133#comment-17599133 ] Eric Payne commented on YARN-9019: -- I'd like to backport this to 3.2 and 2.10. > Ratio calculation of

[jira] [Updated] (YARN-10997) Revisit allocation and reservation logging

2022-07-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10997: -- Fix Version/s: 3.2.4 3.3.9 2.10.3 > Revisit allocation and

[jira] [Commented] (YARN-10997) Revisit allocation and reservation logging

2022-07-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17563977#comment-17563977 ] Eric Payne commented on YARN-10997: --- If it's okay with everyone, I'm going to backport this through

[jira] [Updated] (YARN-11082) Use node label reosurce as denominator to decide which resource is dominated

2022-03-18 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-11082: -- Fix Version/s: (was: 3.1.1) I removed the Fix Version. That field should only be filled in by the

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

2022-02-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490464#comment-17490464 ] Eric Payne commented on YARN-8509: -- I feel that the current implementation is flawed, and my opinion is

[jira] [Commented] (YARN-10821) User limit is not calculated as per definition for preemption

2022-02-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490455#comment-17490455 ] Eric Payne commented on YARN-10821: --- [~gandras], do you still believe we need this JIRA? My opinion is

[jira] [Updated] (YARN-8222) Fix potential NPE when gets RMApp from RM context

2022-02-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8222: - Fix Version/s: 2.10.2 > Fix potential NPE when gets RMApp from RM context >

[jira] [Updated] (YARN-10824) Title not set for JHS and NM webpages

2021-12-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10824: -- Fix Version/s: 3.4.0 2.10.2 3.2.3 3.3.2 >

[jira] [Commented] (YARN-11021) Define Hadoop YARN term "vcore"

2021-12-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-11021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463460#comment-17463460 ] Eric Payne commented on YARN-11021: ---

[jira] [Assigned] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract

2021-12-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-10178: - Assignee: Andras Gyori (was: Qi Zhu) > Global Scheduler async thread crash caused by

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract

2021-12-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463335#comment-17463335 ] Eric Payne commented on YARN-10178: --- [~gandras], I will commit it today. Thanks! > Global Scheduler

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract

2021-12-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462883#comment-17462883 ] Eric Payne commented on YARN-10178: --- No significant difference between most of the performance test

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract

2021-12-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462835#comment-17462835 ] Eric Payne commented on YARN-10178: --- [~gandras], I have reviewed the trunk and branch-2.10 patches. The

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-12-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461023#comment-17461023 ] Eric Payne commented on YARN-10178: --- [~gandras], Thank you very much for the updated patch. The changes

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-12-15 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17460145#comment-17460145 ] Eric Payne commented on YARN-10178: --- [~gandras], if you do decide to pick this up, please post a new

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-12-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17459423#comment-17459423 ] Eric Payne commented on YARN-10178: --- [~gandras], would you like to take this over? I think we are

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-12-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17456774#comment-17456774 ] Eric Payne commented on YARN-10178: --- bq. I believe it is not a problem, as we are not making a copy,

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-12-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17456058#comment-17456058 ] Eric Payne commented on YARN-10178: --- This is a complicated problem, and I'm still trying to get my

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-12-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17453248#comment-17453248 ] Eric Payne commented on YARN-10178: --- [~tuyu], [~zhuqi], [~wangda], [~bteke], [~pbacsko], [~Tao Yang],

[jira] [Commented] (YARN-10939) The task status of the same application on the yarn jobhistory is inconsistent with that on the yarn Web UI

2021-11-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442458#comment-17442458 ] Eric Payne commented on YARN-10939: --- It's hard to debug this issue with just the pictures. However, I

[jira] [Resolved] (YARN-10848) Vcore allocation problem with DefaultResourceCalculator

2021-11-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved YARN-10848. --- Resolution: Not A Problem I am closing this JIRA based on the above discussion. > Vcore allocation

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: YARN-1115.branch-2.10.004.patch > Provide optional means for a scheduler to check real user

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17432729#comment-17432729 ] Eric Payne commented on YARN-1115: -- I attached patch 004 for branch-3.2. The backport from 3.3 was clean

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: YARN-1115.branch-3.2.004.patch > Provide optional means for a scheduler to check real user

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17432600#comment-17432600 ] Eric Payne commented on YARN-1115: -- {quote} |versions|git=2.17.1 maven=3.6.0 spotbugs=4.2.2| {quote}

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17432594#comment-17432594 ] Eric Payne commented on YARN-1115: -- bq. Eric Payne were you able to build branch-3.3 locally? Yes, but

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: YARN-1115.branch-3.3.004.patch > Provide optional means for a scheduler to check real user

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17432096#comment-17432096 ] Eric Payne commented on YARN-1115: -- [~ahussein], the precommit build for patch 004 looks good to me. Can

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17431371#comment-17431371 ] Eric Payne commented on YARN-1115: -- I have now attached version 004 of this patch. Patch 003 fixed most

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: YARN-1115.004.patch > Provide optional means for a scheduler to check real user ACLs >

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: YARN-1115.003.patch > Provide optional means for a scheduler to check real user ACLs >

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: (was: YARN-1115.branch-3.3.002.patch) > Provide optional means for a scheduler to check

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17428951#comment-17428951 ] Eric Payne commented on YARN-1115: -- {quote} |-1|mvninstall|0m

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: YARN-1115.branch-3.3.002.patch > Provide optional means for a scheduler to check real user

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-10-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: YARN-1115.002.patch > Provide optional means for a scheduler to check real user ACLs >

[jira] [Commented] (YARN-8222) Fix potential NPE when gets RMApp from RM context

2021-10-12 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17427832#comment-17427832 ] Eric Payne commented on YARN-8222: -- This bug caused our RM to crash on a production cluster. I will

[jira] [Commented] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2021-10-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17426215#comment-17426215 ] Eric Payne commented on YARN-8546: -- [~Tao Yang], [~cheersyang], if there are no objections, I'll go ahead

[jira] [Resolved] (YARN-9975) Support proxy ACL user for CapacityScheduler

2021-10-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved YARN-9975. -- Resolution: Duplicate I'm closing this as a dup of YARN-1115. Please reopen if you disagree. > Support

[jira] [Commented] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2021-10-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17425185#comment-17425185 ] Eric Payne commented on YARN-8546: -- I uploaded branch-2.10 patch. The {{FiCaSchedulerApp}} changes are

[jira] [Updated] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2021-10-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8546: - Attachment: YARN-8546.branch-2.10.001.patch > Resource leak caused by a reserved container being released

[jira] [Reopened] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2021-10-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-8546: -- > Resource leak caused by a reserved container being released more than once > under async scheduling >

[jira] [Commented] (YARN-8546) Resource leak caused by a reserved container being released more than once under async scheduling

2021-10-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424713#comment-17424713 ] Eric Payne commented on YARN-8546: -- In conjunction with YARN-8127, I'd also like to backport this JIRA to

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2021-10-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424650#comment-17424650 ] Eric Payne commented on YARN-8127: -- Also, FWIW, all tests that ran passed: {noformat} [INFO] Results:

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2021-10-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424217#comment-17424217 ] Eric Payne commented on YARN-8127: -- It looks like the unit tests didn't run because of a VM error:

[jira] [Reopened] (YARN-8127) Resource leak when async scheduling is enabled

2021-10-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-8127: -- Attched branch-2.10 patch. Reopening and putting in PATCH AVAILABLE state to kick the prec-mmit build. The

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2021-10-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8127: - Attachment: YARN-8127.branch-2.10.004.patch > Resource leak when async scheduling is enabled >

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2021-10-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424069#comment-17424069 ] Eric Payne commented on YARN-8127: -- I'd like to backport this to 2.10. If no objections, I'll put up a

[jira] [Commented] (YARN-10938) Support reservation scheduling enabled switch for capacity scheduler

2021-09-30 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17423018#comment-17423018 ] Eric Payne commented on YARN-10938: --- [~Weihao Zheng] Reservations are somewhat integral to the behavior

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-09-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17417744#comment-17417744 ] Eric Payne commented on YARN-1115: -- bq. I re-defined the user variable from String to be

[jira] [Comment Edited] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-09-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416853#comment-17416853 ] Eric Payne edited comment on YARN-1115 at 9/20/21, 4:44 PM: [~gandras], thank

[jira] [Comment Edited] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-09-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416853#comment-17416853 ] Eric Payne edited comment on YARN-1115 at 9/17/21, 6:43 PM: [~gandras], thank

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-09-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416853#comment-17416853 ] Eric Payne commented on YARN-1115: -- [~gandras], thank you a lot for the review! {quote} * Submitting an

[jira] [Commented] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416314#comment-17416314 ] Eric Payne commented on YARN-10935: --- OK, attached branch-3.2 patch. Thanks [~ebadger]. > AM Total

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Attachment: YARN-10935.branch-3.2.003.patch > AM Total Queue Limit goes below per-user AM Limit if

[jira] [Commented] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17416276#comment-17416276 ] Eric Payne commented on YARN-10935: --- Attaching the branch-2.10 patch. Will look into the branch-3.2

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Attachment: YARN-10935.branch-2.10.003.patch > AM Total Queue Limit goes below per-user AM Limit if

[jira] [Commented] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-15 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17415771#comment-17415771 ] Eric Payne commented on YARN-10935: --- Thanks for the reviews, [~ahussein] and [~ebadger]. Branch-2.10

[jira] [Commented] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17414291#comment-17414291 ] Eric Payne commented on YARN-10935: --- [~prabhujoseph], [~sunilg], [~ahussein], [~ebadger], [~snemeth],

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Attachment: YARN-10935.003.patch > AM Total Queue Limit goes below per-user AM Limit if parent is

[jira] [Commented] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17413415#comment-17413415 ] Eric Payne commented on YARN-10935: --- I attached v3 of the patch. > AM Total Queue Limit goes below

[jira] [Commented] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17413374#comment-17413374 ] Eric Payne commented on YARN-10935: --- I suspect I could use {{fitsIn}} instead of

[jira] [Commented] (YARN-9975) Support proxy ACL user for CapacityScheduler

2021-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17413370#comment-17413370 ] Eric Payne commented on YARN-9975: -- AFAICT, the requirements outlined in [zhoukang's comment in

[jira] [Commented] (YARN-10903) Too many "Failed to accept allocation proposal" because of wrong Headroom check for DRF

2021-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17413346#comment-17413346 ] Eric Payne commented on YARN-10903: --- Thanks [~jackwangcs] for your patience and thanks for fixing this

[jira] [Commented] (YARN-10903) Too many "Failed to accept allocation proposal" because of wrong Headroom check for DRF

2021-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17413222#comment-17413222 ] Eric Payne commented on YARN-10903: --- Thanks [~jackwangcs] and [~Tao Yang] for raising the issue and for

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Attachment: YARN-10935.002.patch > AM Total Queue Limit goes below per-user AM Limit if parent is

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Attachment: YARN-10935.001.patch > AM Total Queue Limit goes below per-user AM Limit if parent is

[jira] [Commented] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411398#comment-17411398 ] Eric Payne commented on YARN-10935: --- For example, In the following screenshot, the advertising queue is

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Attachment: Screen Shot 2021-09-07 at 12.55.37 PM.png > AM Total Queue Limit goes below per-user AM

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Attachment: Screen Shot 2021-09-07 at 12.49.52 PM.png > AM Total Queue Limit goes below per-user AM

[jira] [Updated] (YARN-10935) AM Total Queue Limit goes below per-user AM Limit if parent is full.

2021-09-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10935: -- Summary: AM Total Queue Limit goes below per-user AM Limit if parent is full. (was: AM Total Queue

[jira] [Created] (YARN-10935) AM Total Queue Limit goes below per-uwer AM Limit if parent is full.

2021-09-07 Thread Eric Payne (Jira)
Eric Payne created YARN-10935: - Summary: AM Total Queue Limit goes below per-uwer AM Limit if parent is full. Key: YARN-10935 URL: https://issues.apache.org/jira/browse/YARN-10935 Project: Hadoop YARN

[jira] [Assigned] (YARN-10935) AM Total Queue Limit goes below per-uwer AM Limit if parent is full.

2021-09-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-10935: - Assignee: Eric Payne > AM Total Queue Limit goes below per-uwer AM Limit if parent is full. >

[jira] [Commented] (YARN-10899) control whether non-exclusive allocation is used

2021-08-31 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17407699#comment-17407699 ] Eric Payne commented on YARN-10899: --- {quote} When node label expression is empty string, only default

[jira] [Commented] (YARN-10848) Vcore allocation problem with DefaultResourceCalculator

2021-08-31 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17407661#comment-17407661 ] Eric Payne commented on YARN-10848: --- bq. IMO this is breaking the existing behavior of

[jira] [Commented] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-08-26 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17405298#comment-17405298 ] Eric Payne commented on YARN-1115: -- The pre-commit build failed because of the dependency on

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-08-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Description: In the framework for secure implementation using UserGroupInformation.doAs

[jira] [Updated] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2021-08-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1115: - Attachment: YARN-1115.001.patch > Provide optional means for a scheduler to check real user ACLs >

[jira] [Commented] (YARN-9975) Support proxy ACL user for CapacityScheduler

2021-08-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401825#comment-17401825 ] Eric Payne commented on YARN-9975: -- [~cane] / [~snemeth], for about a year, we have been running code in

[jira] [Commented] (YARN-9975) Support proxy ACL user for CapacityScheduler

2021-08-18 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401092#comment-17401092 ] Eric Payne commented on YARN-9975: -- bq. zhoukang, does this JIRA have the same requirements outlined in

[jira] [Commented] (YARN-10505) Extend the maximum-capacity property to support Fair Scheduler migration

2021-08-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397407#comment-17397407 ] Eric Payne commented on YARN-10505: --- Thanks for clearing that up! > Extend the maximum-capacity

[jira] [Commented] (YARN-10505) Extend the maximum-capacity property to support Fair Scheduler migration

2021-08-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17397371#comment-17397371 ] Eric Payne commented on YARN-10505: --- bq. Please note, that the new, recommended format does not support

[jira] [Commented] (YARN-10456) RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry

2021-07-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380826#comment-17380826 ] Eric Payne commented on YARN-10456: --- [~Jim_Brennan], [~ebadger], [~edfi202], [~prabhujoseph],

[jira] [Updated] (YARN-10456) RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry

2021-07-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10456: -- Attachment: YARN-10456.001.patch > RM PartitionQueueMetrics records are named QueueMetrics in Simon

[jira] [Comment Edited] (YARN-10821) User limit is not calculated as per definition for preemption

2021-07-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376054#comment-17376054 ] Eric Payne edited comment on YARN-10821 at 7/6/21, 10:00 PM: - {quote}

[jira] [Commented] (YARN-10821) User limit is not calculated as per definition for preemption

2021-07-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376054#comment-17376054 ] Eric Payne commented on YARN-10821: --- {quote} {noformat} max ((total resources consumed by active users)

[jira] [Updated] (YARN-10834) Intra-queue preemption: apps that don't use defined custom resource won't be preempted.

2021-06-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10834: -- Attachment: YARN-10834.branch-2.10.001.patch > Intra-queue preemption: apps that don't use defined

[jira] [Commented] (YARN-10834) Intra-queue preemption: apps that don't use defined custom resource won't be preempted.

2021-06-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370890#comment-17370890 ] Eric Payne commented on YARN-10834: --- Thanks very much, [~Jim_Brennan]. I have uploaded a branch-2.10

[jira] [Updated] (YARN-10834) Intra-queue preemption: apps that don't use defined custom resource won't be preempted.

2021-06-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10834: -- Attachment: YARN-10834.001.patch > Intra-queue preemption: apps that don't use defined custom resource

[jira] [Created] (YARN-10834) Intra-queue preemption: apps that don't use defined custom resource won't be preempted.

2021-06-25 Thread Eric Payne (Jira)
Eric Payne created YARN-10834: - Summary: Intra-queue preemption: apps that don't use defined custom resource won't be preempted. Key: YARN-10834 URL: https://issues.apache.org/jira/browse/YARN-10834

[jira] [Commented] (YARN-10824) Title not set for JHS and NM webpages

2021-06-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366828#comment-17366828 ] Eric Payne commented on YARN-10824: --- bq. I'm not sure "About the Node" is a good title for the node

[jira] [Comment Edited] (YARN-10821) User limit is not calculated as per definition for preemption

2021-06-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366823#comment-17366823 ] Eric Payne edited comment on YARN-10821 at 6/21/21, 8:08 PM: - [~gandras], can

[jira] [Comment Edited] (YARN-10821) User limit is not calculated as per definition for preemption

2021-06-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366823#comment-17366823 ] Eric Payne edited comment on YARN-10821 at 6/21/21, 8:07 PM: - [~gandras], can

[jira] [Commented] (YARN-10821) User limit is not calculated as per definition for preemption

2021-06-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366823#comment-17366823 ] Eric Payne commented on YARN-10821: --- [~gandras], can you please provide a step-by-step use case to

[jira] [Commented] (YARN-10821) User limit is not calculated as per definition for preemption

2021-06-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364966#comment-17364966 ] Eric Payne commented on YARN-10821: --- [~gandras], I am running behind. I will try to get back to this

[jira] [Commented] (YARN-10802) Change Capacity Scheduler minimum-user-limit-percent to accept decimal values

2021-06-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363215#comment-17363215 ] Eric Payne commented on YARN-10802: --- [~bteke], Thanks for raising this issue and for working on it. I

[jira] [Commented] (YARN-10821) User limit is not calculated as per definition for preemption

2021-06-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363171#comment-17363171 ] Eric Payne commented on YARN-10821: --- {quote} - In UsersManager#computeUserLimit the userLimit is

[jira] [Commented] (YARN-10821) User limit is not calculated as per definition for preemption

2021-06-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363169#comment-17363169 ] Eric Payne commented on YARN-10821: --- {quote} In LeafQueue#getUserAMResourceLimitPerPartition an

[jira] [Commented] (YARN-10821) User limit is not calculated as per definition for preemption

2021-06-14 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363004#comment-17363004 ] Eric Payne commented on YARN-10821: --- Thanks [~gandras] for bringing this up. I will take a look. >

  1   2   3   4   5   6   7   8   9   10   >