[jira] [Commented] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used

2020-06-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17126100#comment-17126100 ] Eric Payne commented on YARN-10283: --- [~Jim_Brennan], it looks like the patch applies cl

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17125351#comment-17125351 ] Eric Payne commented on YARN-9903: -- [~Jim_Brennan], The code changes in the latest patch

[jira] [Commented] (YARN-10283) Capacity Scheduler: starvation occurs if a higher priority queue is full and node labels are used

2020-06-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17125342#comment-17125342 ] Eric Payne commented on YARN-10283: --- bq. Please feel free to pull in the additional cha

[jira] [Commented] (YARN-9903) Support reservations continue looking for Node Labels

2020-06-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17125136#comment-17125136 ] Eric Payne commented on YARN-9903: -- As [~Jim_Brennan] pointed out, our usage of node labe

[jira] [Updated] (YARN-10251) Show extended resources on legacy RM UI.

2020-06-01 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10251: -- Attachment: YARN-10251.003.patch > Show extended resources on legacy RM UI. > -

[jira] [Updated] (YARN-10251) Show extended resources on legacy RM UI.

2020-06-01 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10251: -- Attachment: YARN-10251.branch-2.10.003.patch > Show extended resources on legacy RM UI. > -

[jira] [Updated] (YARN-10251) Show extended resources on legacy RM UI.

2020-05-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10251: -- Attachment: Updated RM UI With All Resources Shown.png.png Updated NodesPage UI With GPU

[jira] [Updated] (YARN-10251) Show extended resources on legacy RM UI.

2020-05-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10251: -- Attachment: (was: Updated Legacy RM UI With All Resources Shown.png) > Show extended resources on l

[jira] [Updated] (YARN-10251) Show extended resources on legacy RM UI.

2020-05-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10251: -- Attachment: YARN-10251.branch-2.10.002.patch > Show extended resources on legacy RM UI. > -

[jira] [Updated] (YARN-10251) Show extended resources on legacy RM UI.

2020-05-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10251: -- Attachment: YARN-10251.branch-2.10.001.patch > Show extended resources on legacy RM UI. > -

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104711#comment-17104711 ] Eric Payne commented on YARN-6492: -- {quote} IMO we should still have {code:java} "name"

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17104657#comment-17104657 ] Eric Payne commented on YARN-6492: -- {quote} {code:java} "name" : "Hadoop:service=Resourc

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17102945#comment-17102945 ] Eric Payne commented on YARN-6492: -- Thanks [~maniraj...@gmail.com] for working to move th

[jira] [Commented] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17102782#comment-17102782 ] Eric Payne commented on YARN-9444: -- Thanks for the original patch [~shuzirra] and for the

[jira] [Commented] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17101975#comment-17101975 ] Eric Payne commented on YARN-9444: -- I backported the trunk commit to branch-3.2 and branc

[jira] [Commented] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17101917#comment-17101917 ] Eric Payne commented on YARN-9444: -- I am able to backport the trunk commit revision direc

[jira] [Updated] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9444: - Attachment: YARN-9444.branch-2.10.003.patch > YARN API ResourceUtils's getRequestedResourcesFromConfig doe

[jira] [Updated] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9444: - Attachment: commit.repo > YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize > ya

[jira] [Updated] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9444: - Attachment: (was: commit.repo) > YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't reco

[jira] [Commented] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099314#comment-17099314 ] Eric Payne commented on YARN-9444: -- I have patches available for 3.2, 3.1, and 2.10. Woul

[jira] [Commented] (YARN-9444) YARN API ResourceUtils's getRequestedResourcesFromConfig doesn't recognize yarn.io/gpu as a valid resource

2020-05-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17099112#comment-17099112 ] Eric Payne commented on YARN-9444: -- Hi [~shuzirra]. Good work on reporting and fixing thi

[jira] [Updated] (YARN-10251) Show extended resources on legacy RM UI.

2020-04-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10251: -- Description: It would be great to update the legacy RM UI to include GPU resources in the overview and

[jira] [Created] (YARN-10251) Show extended resources on legacy RM UI.

2020-04-28 Thread Eric Payne (Jira)
Eric Payne created YARN-10251: - Summary: Show extended resources on legacy RM UI. Key: YARN-10251 URL: https://issues.apache.org/jira/browse/YARN-10251 Project: Hadoop YARN Issue Type: Improvemen

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

2020-04-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17090843#comment-17090843 ] Eric Payne commented on YARN-1529: -- bq. It might be worth splitting the patch so the les

[jira] [Updated] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2020-04-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4771: - Target Version/s: (was: 2.7.5) > Some containers can be skipped during log aggregation after NM restart

[jira] [Updated] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2020-04-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4771: - Affects Version/s: (was: 2.7.2) 2.10.0 3.2.1

[jira] [Commented] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

2020-04-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17090800#comment-17090800 ] Eric Payne commented on YARN-4771: -- bq. This is going to be problematic, impacting NM mem

[jira] [Commented] (YARN-10227) Pull YARN-8242 back to branch-2.10

2020-04-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17079580#comment-17079580 ] Eric Payne commented on YARN-10227: --- The 2.10 patch looks good. +1 > Pull YARN-8242 ba

[jira] [Commented] (YARN-10227) Pull YARN-8242 back to branch-2.10

2020-04-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17079461#comment-17079461 ] Eric Payne commented on YARN-10227: --- My preference is to re-open the original JIRA. Tha

[jira] [Commented] (YARN-10192) CapacityScheduler stuck in loop rejecting allocation proposals

2020-03-12 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17058049#comment-17058049 ] Eric Payne commented on YARN-10192: --- [~jhung], I'm not sure this is related, but does t

[jira] [Commented] (YARN-9427) TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers fails sporadically

2020-03-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17055419#comment-17055419 ] Eric Payne commented on YARN-9427: -- Thanks for the patch, [~ahussein]. +1 LGTM I will c

[jira] [Created] (YARN-10164) Allow NM to start even when custom resource type not defined

2020-02-25 Thread Eric Payne (Jira)
Eric Payne created YARN-10164: - Summary: Allow NM to start even when custom resource type not defined Key: YARN-10164 URL: https://issues.apache.org/jira/browse/YARN-10164 Project: Hadoop YARN I

[jira] [Updated] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-02-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-9018: - Fix Version/s: 2.10.1 3.1.4 3.2.2 3.3.0 > Add fun

[jira] [Commented] (YARN-10140) TestTimelineAuthFilterForV2 fails due to login failures in branch-2.10

2020-02-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17044565#comment-17044565 ] Eric Payne commented on YARN-10140: --- Thanks [~ahussein] for raising the issue and for p

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2020-02-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17031864#comment-17031864 ] Eric Payne commented on YARN-8292: -- [~jhung] / [~leftnoteasy], Would it be possible for

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-2.10.006.patch > Allow inheritance of max app lifetime / default app life

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-3.1.006.patch > Allow inheritance of max app lifetime / default app lifet

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-3.2.006.patch > Allow inheritance of max app lifetime / default app lifet

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17025320#comment-17025320 ] Eric Payne commented on YARN-10084: --- [~Jim_Brennan] and [~ebadger], thanks for your rev

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.006.patch > Allow inheritance of max app lifetime / default app lifetime > -

[jira] [Comment Edited] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023225#comment-17023225 ] Eric Payne edited comment on YARN-10084 at 1/24/20 7:59 PM: A

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023225#comment-17023225 ] Eric Payne commented on YARN-10084: --- All patches are uploaded. Here is the breakdown of

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-2.10.005.patch > Allow inheritance of max app lifetime / default app life

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023105#comment-17023105 ] Eric Payne commented on YARN-10084: --- I attached patch for branch-3.1 > Allow inheritan

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-3.1.005.patch > Allow inheritance of max app lifetime / default app lifet

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023103#comment-17023103 ] Eric Payne commented on YARN-10084: --- Unit test failures for TestCombinedSystemMetricsPu

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.branch-3.2.005.patch > Allow inheritance of max app lifetime / default app lifet

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.005.patch > Allow inheritance of max app lifetime / default app lifetime > -

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022516#comment-17022516 ] Eric Payne commented on YARN-10084: --- Thanks [~ebadger]. I uploaded patch 005 that inclu

[jira] [Resolved] (YARN-9790) Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved YARN-9790. -- Fix Version/s: 2.10.1 3.1.4 3.2.2 Resolution: Fixed > Faile

[jira] [Commented] (YARN-9790) Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022467#comment-17022467 ] Eric Payne commented on YARN-9790: -- Backport completed. > Failed to set default-applicat

[jira] [Commented] (YARN-10094) Add configuration to support NM overuse in RM

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022263#comment-17022263 ] Eric Payne commented on YARN-10094: --- YARN-1011 also seems to be very similar. > Add co

[jira] [Reopened] (YARN-9790) Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero

2020-01-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-9790: -- Reopening to backport to branch-3.2, 3.1, and 2.10. > Failed to set default-application-lifetime if maximum

[jira] [Commented] (YARN-10094) Add configuration to support NM overuse in RM

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021610#comment-17021610 ] Eric Payne commented on YARN-10094: --- [~cane], I feel that this JIRA may have the same g

[jira] [Commented] (YARN-10090) ApplicationNotFoundException will cause a UndeclaredThrowableException

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021605#comment-17021605 ] Eric Payne commented on YARN-10090: --- [~yzzjjyy], can you please tell me where you are s

[jira] [Commented] (YARN-10091) Support clean up orphan app's log in LogAggService

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021587#comment-17021587 ] Eric Payne commented on YARN-10091: --- [~cane], can you please be more specific? What is

[jira] [Commented] (YARN-9790) Failed to set default-application-lifetime if maximum-application-lifetime is less than or equal to zero

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021574#comment-17021574 ] Eric Payne commented on YARN-9790: -- If there are no objections, I'd like to backport this

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.004.patch > Allow inheritance of max app lifetime / default app lifetime > -

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021554#comment-17021554 ] Eric Payne commented on YARN-10084: --- I clicked on the "compile" link above and it says:

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021440#comment-17021440 ] Eric Payne commented on YARN-10084: --- Thanks [~Jim_Brennan]. I uploaded version 003. >

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.003.patch > Allow inheritance of max app lifetime / default app lifetime > -

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021294#comment-17021294 ] Eric Payne commented on YARN-10084: --- Version 002 attached. I did not change the logic s

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17021287#comment-17021287 ] Eric Payne commented on YARN-10084: --- Okay. Thanks for your further analysis, [~Jim_Bren

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.002.patch > Allow inheritance of max app lifetime / default app lifetime > -

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020605#comment-17020605 ] Eric Payne commented on YARN-10084: --- {quote} For some reason, I was under the impressio

[jira] [Commented] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020602#comment-17020602 ] Eric Payne commented on YARN-10084: --- bq. should you be checking for >= 0 instead of >0

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: (was: BUILDING.txt) > Allow inheritance of max app lifetime / default app lifetime > --

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: BUILDING.txt > Allow inheritance of max app lifetime / default app lifetime > -

[jira] [Updated] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10084: -- Attachment: YARN-10084.001.patch > Allow inheritance of max app lifetime / default app lifetime > -

[jira] [Created] (YARN-10084) Allow inheritance of max app lifetime / default app lifetime

2020-01-13 Thread Eric Payne (Jira)
Eric Payne created YARN-10084: - Summary: Allow inheritance of max app lifetime / default app lifetime Key: YARN-10084 URL: https://issues.apache.org/jira/browse/YARN-10084 Project: Hadoop YARN I

[jira] [Commented] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011054#comment-17011054 ] Eric Payne commented on YARN-9018: -- +1. I will commit tomorrow if no objections. > Add f

[jira] [Comment Edited] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011001#comment-17011001 ] Eric Payne edited comment on YARN-9018 at 1/8/20 8:36 PM: -- The pa

[jira] [Commented] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17011001#comment-17011001 ] Eric Payne commented on YARN-9018: -- I kicked the precommit build > Add functionality to

[jira] [Commented] (YARN-9018) Add functionality to AuxiliaryLocalPathHandler to return all locations to read for a given path

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010996#comment-17010996 ] Eric Payne commented on YARN-9018: -- We've been running with this internally for a long ti

[jira] [Commented] (YARN-7387) org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-7387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010940#comment-17010940 ] Eric Payne commented on YARN-7387: -- Thanks for the fix, [~Jim_Brennan]. The changes LGTM.

[jira] [Commented] (YARN-9052) Replace all MockRM submit method definitions with a builder

2020-01-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010710#comment-17010710 ] Eric Payne commented on YARN-9052: -- {quote}I am a little bit concerned with Jiras that so

[jira] [Commented] (YARN-10072) TestCSAllocateCustomResource failures

2020-01-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010147#comment-17010147 ] Eric Payne commented on YARN-10072: --- +1. I'll commit tomorrow and port all branches bac

[jira] [Commented] (YARN-10004) Javadoc of YarnConfigurationStore#initialize is not straightforward

2020-01-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010136#comment-17010136 ] Eric Payne commented on YARN-10004: --- [~snemeth], can you please be more specific about

[jira] [Commented] (YARN-10072) TestCSAllocateCustomResource failures

2020-01-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009938#comment-17009938 ] Eric Payne commented on YARN-10072: --- [~Jim_Brennan], the new CheckStyle warnings are du

[jira] [Commented] (YARN-10072) TestCSAllocateCustomResource failures

2020-01-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17009882#comment-17009882 ] Eric Payne commented on YARN-10072: --- The changes look good to me. I'll wait for the pre

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17001721#comment-17001721 ] Eric Payne commented on YARN-10009: --- Thanks a lot for the help, [~ebadger] and [~leftno

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17001030#comment-17001030 ] Eric Payne commented on YARN-10009: --- [~ebadger], thanks for the review. bq. the other d

[jira] [Updated] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10009: -- Attachment: YARN-10009.004.patch > In Capacity Scheduler, DRC can treat minimum user limit percent as a

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-12-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000257#comment-17000257 ] Eric Payne commented on YARN-6492: -- Thanks [~maniraj...@gmail.com] for all the work on th

[jira] [Commented] (YARN-9767) PartitionQueueMetrics Issues

2019-12-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000205#comment-17000205 ] Eric Payne commented on YARN-9767: -- [~maniraj...@gmail.com], Thanks for raising this issu

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000184#comment-17000184 ] Eric Payne commented on YARN-10009: --- This is kind of a blocker for us. Would it be okay

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-19 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000125#comment-17000125 ] Eric Payne commented on YARN-8292: -- Thanks a lot [~jhung] for looking at this. I apologiz

[jira] [Commented] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

2019-12-18 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16999523#comment-16999523 ] Eric Payne commented on YARN-9894: -- Thanks [~jhung]! > CapacitySchedulerPerf test for me

[jira] [Commented] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-18 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16999203#comment-16999203 ] Eric Payne commented on YARN-10033: --- Thanks [~ebadger]! > TestProportionalCapacityPree

[jira] [Commented] (YARN-10009) In Capacity Scheduler, DRC can treat minimum user limit percent as a max when custom resource is defined

2019-12-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16998290#comment-16998290 ] Eric Payne commented on YARN-10009: --- [~leftnoteasy], any cycles for this? > In Capacit

[jira] [Updated] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10033: -- Attachment: YARN-10033.003.patch > TestProportionalCapacityPreemptionPolicy not initializing vcores for

[jira] [Commented] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997701#comment-16997701 ] Eric Payne commented on YARN-10033: --- Thanks a lot for the review, [~ebadger]. Yes, I ag

[jira] [Commented] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997612#comment-16997612 ] Eric Payne commented on YARN-10033: --- [~ebadger], would you mind taking a look? > TestP

[jira] [Updated] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10033: -- Affects Version/s: 3.2.1 3.1.3 > TestProportionalCapacityPreemptionPolicy not in

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8292: - Attachment: YARN-8292.branch-2.10.011.patch > Fix the dominant resource preemption cannot happen when some

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8292: - Attachment: (was: YARN-8292.branch-2.011.patch) > Fix the dominant resource preemption cannot happen w

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995876#comment-16995876 ] Eric Payne commented on YARN-8292: -- I attached patch version 011 for branch-2.10. The ch

[jira] [Updated] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8292: - Attachment: YARN-8292.branch-2.011.patch > Fix the dominant resource preemption cannot happen when some of

[jira] [Updated] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10033: -- Attachment: YARN-10033.002.patch > TestProportionalCapacityPreemptionPolicy not initializing vcores for

[jira] [Updated] (YARN-10033) TestProportionalCapacityPreemptionPolicy not initializing vcores for effective max resources

2019-12-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10033: -- Attachment: YARN-10033.001.patch > TestProportionalCapacityPreemptionPolicy not initializing vcores for

<    1   2   3   4   5   6   7   8   9   10   >