[jira] [Commented] (YARN-10479) RMProxy should retry on SocketTimeout Exceptions

2020-11-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17227063#comment-17227063 ] Eric Payne commented on YARN-10479: --- Thanks [~Jim_Brennan]. I committed this to 3.1 through trunk. >

[jira] [Commented] (YARN-10479) RMProxy should retry on SocketTimeout Exceptions

2020-11-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226968#comment-17226968 ] Eric Payne commented on YARN-10479: --- Thanks for raising this issue and providing the patch,

[jira] [Commented] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-11-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226857#comment-17226857 ] Eric Payne commented on YARN-10278: --- {quote} bq. It seems like branch-2.10 would involve more work as

[jira] [Commented] (YARN-10479) RMProxy should retry on SocketTimeout Exceptions

2020-11-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17226818#comment-17226818 ] Eric Payne commented on YARN-10479: --- Sure thing > RMProxy should retry on SocketTimeout Exceptions >

[jira] [Commented] (YARN-10475) Scale RM-NM heartbeat interval based on node utilization

2020-10-30 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223818#comment-17223818 ] Eric Payne commented on YARN-10475: --- Thanks [~Jim_Brennan] for providing resolutions for this issue,

[jira] [Commented] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223200#comment-17223200 ] Eric Payne commented on YARN-10471: --- Thanks a lot, [~Jim_Brennan]! I don't think it's necessary to

[jira] [Commented] (YARN-10475) Scale RM-NM heartbeat interval based on node utilization

2020-10-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223196#comment-17223196 ] Eric Payne commented on YARN-10475: --- [~Jim_Brennan], Thanks for working on this feature and providing

[jira] [Updated] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10471: -- Attachment: YARN.10471.branch-3.2.005.patch > Prevent logs for any container from becoming larger than

[jira] [Commented] (YARN-10475) Scale RM-NM heartbeat interval based on node utilization

2020-10-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222481#comment-17222481 ] Eric Payne commented on YARN-10475: --- [~Jim_Brennan], please add documentation for the new config

[jira] [Commented] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222471#comment-17222471 ] Eric Payne commented on YARN-10471: --- Thanks [~Jim_Brennan]. I have uploaded a new patch. > Prevent

[jira] [Updated] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10471: -- Attachment: YARN.10471.005.patch > Prevent logs for any container from becoming larger than a

[jira] [Commented] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222396#comment-17222396 ] Eric Payne commented on YARN-10471: --- Thanks a lot, [~Jim_Brennan], for reviewing these patches. I

[jira] [Updated] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10471: -- Attachment: YARN.10471.004.patch > Prevent logs for any container from becoming larger than a

[jira] [Commented] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1715#comment-1715 ] Eric Payne commented on YARN-10471: --- The unit tests that failed in the branch 2 pre-commit build also

[jira] [Commented] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221802#comment-17221802 ] Eric Payne commented on YARN-10471: --- Needed a branch-3.2 patch to resolve conflicts. > Prevent logs

[jira] [Updated] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10471: -- Attachment: YARN.10471.branch-3.2.003.patch > Prevent logs for any container from becoming larger than

[jira] [Commented] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221621#comment-17221621 ] Eric Payne commented on YARN-10471: --- I attached version 003 of the patch. > Prevent logs for any

[jira] [Updated] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10471: -- Attachment: YARN.10471.003.patch > Prevent logs for any container from becoming larger than a

[jira] [Commented] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221515#comment-17221515 ] Eric Payne commented on YARN-10471: --- I just noticed the javac warnings, so I will have to create and

[jira] [Commented] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-26 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220982#comment-17220982 ] Eric Payne commented on YARN-10471: --- I attached version 002 of the patch. This patch addressed the

[jira] [Updated] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-26 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10471: -- Attachment: YARN.10471.002.patch > Prevent logs for any container from becoming larger than a

[jira] [Commented] (YARN-10431) [Umbrella] Job group management

2020-10-26 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220868#comment-17220868 ] Eric Payne commented on YARN-10431: --- [~wjlei], does [Oozie|http://oozie.apache.org] meet the same

[jira] [Updated] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10471: -- Attachment: YARN.10471.001.patch > Prevent logs for any container from becoming larger than a

[jira] [Commented] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219901#comment-17219901 ] Eric Payne commented on YARN-10471: --- I propose a solution that includes the option to limit the disk

[jira] [Commented] (YARN-950) Ability to limit or avoid aggregating logs beyond a certain size

2020-10-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219874#comment-17219874 ] Eric Payne commented on YARN-950: - {quote}1. Prevent logs for any container from becoming larger than a

[jira] [Created] (YARN-10471) Prevent logs for any container from becoming larger than a configurable size.

2020-10-23 Thread Eric Payne (Jira)
Eric Payne created YARN-10471: - Summary: Prevent logs for any container from becoming larger than a configurable size. Key: YARN-10471 URL: https://issues.apache.org/jira/browse/YARN-10471 Project:

[jira] [Commented] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-10-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219786#comment-17219786 ] Eric Payne commented on YARN-10278: --- bq. Will check once again how much work would be to backport the

[jira] [Commented] (YARN-10452) YARN scheduler response returns invalid values for capacity, maxCapacity and absoluteMaxCapacity

2020-10-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217943#comment-17217943 ] Eric Payne commented on YARN-10452: --- Actually, I think this is expected. > YARN scheduler response

[jira] [Commented] (YARN-10456) RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry

2020-10-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215416#comment-17215416 ] Eric Payne commented on YARN-10456: --- Both {{CSQueueMetrics}} and {{FSQueueMetrics}} are also children

[jira] [Commented] (YARN-10456) RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry

2020-10-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17211439#comment-17211439 ] Eric Payne commented on YARN-10456: --- We use hadoop-metrics2.properties to set up Simon metrics

[jira] [Created] (YARN-10456) RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry

2020-10-09 Thread Eric Payne (Jira)
Eric Payne created YARN-10456: - Summary: RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry Key: YARN-10456 URL: https://issues.apache.org/jira/browse/YARN-10456 Project:

[jira] [Commented] (YARN-10451) RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is defined.

2020-10-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17209004#comment-17209004 ] Eric Payne commented on YARN-10451: --- I attached the branch-3.2 patch. In trunk and branch-3,

[jira] [Updated] (YARN-10451) RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is defined.

2020-10-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10451: -- Attachment: YARN-10451.branch-3.2.003.patch > RM (v1) UI NodesPage can NPE when yarn.io/gpu resource

[jira] [Commented] (YARN-10451) RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is defined.

2020-10-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208794#comment-17208794 ] Eric Payne commented on YARN-10451: --- Thanks for the review, [~Jim_Brennan]. bq. Why did you need the

[jira] [Commented] (YARN-10451) RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is defined.

2020-10-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17208308#comment-17208308 ] Eric Payne commented on YARN-10451: --- Thanks [~Jim_Brennan] and [~sunilg] for the reviews. I have

[jira] [Updated] (YARN-10451) RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is defined.

2020-10-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10451: -- Attachment: YARN-10451.003.patch > RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is

[jira] [Updated] (YARN-10451) RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is defined.

2020-10-02 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10451: -- Attachment: YARN-10451.002.patch > RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is

[jira] [Updated] (YARN-10451) RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is defined.

2020-10-02 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10451: -- Attachment: YARN-10451.001.patch > RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is

[jira] [Commented] (YARN-10451) RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is defined.

2020-10-02 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17206398#comment-17206398 ] Eric Payne commented on YARN-10451: --- {code:title=NodePages#NodesBlock} if (gpuIndex != null) {

[jira] [Created] (YARN-10451) RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is defined.

2020-10-02 Thread Eric Payne (Jira)
Eric Payne created YARN-10451: - Summary: RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is defined. Key: YARN-10451 URL: https://issues.apache.org/jira/browse/YARN-10451 Project: Hadoop YARN

[jira] [Assigned] (YARN-10451) RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is defined.

2020-10-02 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-10451: - Assignee: Eric Payne > RM (v1) UI NodesPage can NPE when yarn.io/gpu resource type is defined.

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-09-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203473#comment-17203473 ] Eric Payne commented on YARN-9809: -- I have committed this to branch-3.3 and branch-3.2. It looks like

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-09-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17203346#comment-17203346 ] Eric Payne commented on YARN-9809: -- The latest branch-3.2 precommit build looks fine. The unit test

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-09-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202390#comment-17202390 ] Eric Payne commented on YARN-9809: -- Version 009 LGTM. +1 > NMs should supply a health status when

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-09-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17202388#comment-17202388 ] Eric Payne commented on YARN-9809: -- Thanks a lot, [~ebadger] for the backport, and thank you

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-09-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201061#comment-17201061 ] Eric Payne commented on YARN-9809: -- Thanks a lot [~ebadger] for putting upt the 3.2 backport patch. I'm

[jira] [Commented] (YARN-950) Ability to limit or avoid aggregating logs beyond a certain size

2020-09-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194507#comment-17194507 ] Eric Payne commented on YARN-950: - [~adam.antal], are you still planning on working on this JIRA? bq. Ran

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-11 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17194279#comment-17194279 ] Eric Payne commented on YARN-10390: --- Thanks [~samkhan] for this important performance enhancement. +1.

[jira] [Updated] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10390: -- Attachment: YARN-10390-branch-3.1.002.patch > LeafQueue: retain user limits cache across

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193841#comment-17193841 ] Eric Payne commented on YARN-10390: --- Uploaded branch-3.2 patch because of merge conflicts in unit

[jira] [Updated] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10390: -- Attachment: YARN-10390-branch-3.2.002.patch > LeafQueue: retain user limits cache across

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193833#comment-17193833 ] Eric Payne commented on YARN-10390: --- Unit test failure for {{TestFairSchedulerPreemption}} is the same

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193731#comment-17193731 ] Eric Payne commented on YARN-10390: --- Uploaded patch to kick pre-commit build so we can have a record in

[jira] [Updated] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10390: -- Attachment: YARN-10390.002.patch > LeafQueue: retain user limits cache across assignContainers() calls

[jira] [Reopened] (YARN-10369) Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG

2020-09-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-10369: --- Had to make a formatting change for 3.1. I will upload the 3.1 patch and kick the YARN precommit build

[jira] [Updated] (YARN-10369) Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG

2020-09-08 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10369: -- Attachment: YARN-10369-branch-3.1.patch > Make NMTokenSecretManagerInRM sending NMToken for nodeId

[jira] [Reopened] (YARN-10353) Log vcores used and cumulative cpu in containers monitor

2020-09-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened YARN-10353: --- As I was backporting this to 3.2, there were a couple of minor formatting changes, but I want to kick

[jira] [Updated] (YARN-10353) Log vcores used and cumulative cpu in containers monitor

2020-09-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10353: -- Attachment: YARN-10353-branch-3.2.002.patch > Log vcores used and cumulative cpu in containers monitor

[jira] [Assigned] (YARN-10403) Add helpful error message for queue refresh issued via RM admin CLI

2020-09-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-10403: - Assignee: Bruce Szudera Wienand [~brucesw], sorry for the late response. I was able to assign

[jira] [Commented] (YARN-10177) Backport YARN-7307 to branch-2.10 Allow client/AM update supported resource types via YARN APIs

2020-09-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190865#comment-17190865 ] Eric Payne commented on YARN-10177: --- +1 LGTM > Backport YARN-7307 to branch-2.10 Allow client/AM

[jira] [Commented] (YARN-10177) Backport YARN-7307 to branch-2.10 Allow client/AM update supported resource types via YARN APIs

2020-09-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190782#comment-17190782 ] Eric Payne commented on YARN-10177: --- Thanks [~sunilg] for the original work, [~weichiu] for the effort

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-09-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190414#comment-17190414 ] Eric Payne commented on YARN-9809: -- [~ebadger], this doesn't backport cleanly to 3.2. Would you mind

[jira] [Commented] (YARN-10369) Make NMTokenSecretManagerInRM sending NMToken for nodeId DEBUG

2020-09-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190394#comment-17190394 ] Eric Payne commented on YARN-10369: --- Unless there are objections, I would like to backport this to 3.1.

[jira] [Commented] (YARN-10353) Log vcores used and cumulative cpu in containers monitor

2020-09-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190393#comment-17190393 ] Eric Payne commented on YARN-10353: --- Unless there are objections, I would like to backport this to 3.1.

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2020-09-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17190392#comment-17190392 ] Eric Payne commented on YARN-9809: -- Unless there are objections, I would like to backport this to 3.1. >

[jira] [Commented] (YARN-8459) Improve Capacity Scheduler logs to debug invalid states

2020-08-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17175047#comment-17175047 ] Eric Payne commented on YARN-8459: -- Thanks [~Jim_Brennan] for the updated patch. Yes, I think we should

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-08-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17175022#comment-17175022 ] Eric Payne commented on YARN-10251: --- Thank you very much, [~jhung] and [~Jim_Brennan]! > Show extended

[jira] [Commented] (YARN-10384) Add FORBID_SUBMIT_APPLICATIONS acl type to administer queue

2020-08-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174430#comment-17174430 ] Eric Payne commented on YARN-10384: --- Also, FYI, we don't enter anything in the {{Fix Version}} field

[jira] [Updated] (YARN-10384) Add FORBID_SUBMIT_APPLICATIONS acl type to administer queue

2020-08-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10384: -- Fix Version/s: (was: 3.2.0) [~jutia], Thank you for suggesting this improvement. While this may

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-08-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173217#comment-17173217 ] Eric Payne commented on YARN-10251: --- Hey [~jhung], I think this is ready to go, if you wouldn't mind

[jira] [Updated] (YARN-10251) Show extended resources on legacy RM UI.

2020-08-06 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10251: -- Attachment: YARN-10251.branch-2.10.007.patch > Show extended resources on legacy RM UI. >

[jira] [Commented] (YARN-4575) ApplicationResourceUsageReport should return ALL reserved resource

2020-08-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171737#comment-17171737 ] Eric Payne commented on YARN-4575: -- Thanks a lot [~ebadger]! I attached YARN-4575.branch-3.1..005.patch,

[jira] [Updated] (YARN-4575) ApplicationResourceUsageReport should return ALL reserved resource

2020-08-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4575: - Attachment: YARN-4575.branch-3.1..005.patch > ApplicationResourceUsageReport should return ALL reserved

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-08-05 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171691#comment-17171691 ] Eric Payne commented on YARN-10251: --- I don't think the pre-Commit branch-3.2 unit test failuress are

[jira] [Updated] (YARN-10251) Show extended resources on legacy RM UI.

2020-08-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10251: -- Attachment: YARN-10251.branch-3.2.007.patch > Show extended resources on legacy RM UI. >

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-08-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171123#comment-17171123 ] Eric Payne commented on YARN-10251: --- Thanks [~Jim_Brennan]. I will upload the branch-3.2 patch, which

[jira] [Commented] (YARN-4575) ApplicationResourceUsageReport should return ALL reserved resource

2020-08-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171023#comment-17171023 ] Eric Payne commented on YARN-4575: -- bq. could you address the 2 checkstyle issues? Sure. Uploading patch

[jira] [Updated] (YARN-4575) ApplicationResourceUsageReport should return ALL reserved resource

2020-08-04 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4575: - Attachment: YARN-4575.005.patch > ApplicationResourceUsageReport should return ALL reserved resource >

[jira] [Updated] (YARN-10251) Show extended resources on legacy RM UI.

2020-08-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10251: -- Attachment: YARN-10251.007.patch > Show extended resources on legacy RM UI. >

[jira] [Commented] (YARN-2695) Support continuously looking reserved container with node labels

2020-07-31 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-2695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169116#comment-17169116 ] Eric Payne commented on YARN-2695: -- Yup. It looks to be a dup. > Support continuously looking reserved

[jira] [Commented] (YARN-4575) ApplicationResourceUsageReport should return ALL reserved resource

2020-07-31 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17169080#comment-17169080 ] Eric Payne commented on YARN-4575: -- I think this is ready for review. Can I get someone to take a loo? >

[jira] [Comment Edited] (YARN-4575) ApplicationResourceUsageReport should return ALL reserved resource

2020-07-30 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17168205#comment-17168205 ] Eric Payne edited comment on YARN-4575 at 7/30/20, 8:45 PM: I'm not sure why 2

[jira] [Commented] (YARN-4575) ApplicationResourceUsageReport should return ALL reserved resource

2020-07-30 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17168205#comment-17168205 ] Eric Payne commented on YARN-4575: -- I'm not sure why 2 pre-commit builds are being triggered.

[jira] [Updated] (YARN-1529) Add Localization overhead metrics to NM

2020-07-30 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-1529: - Fix Version/s: 3.1.5 3.3.1 3.4.0 2.10.1

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

2020-07-30 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17168122#comment-17168122 ] Eric Payne commented on YARN-1529: -- I don't know why 2 pre-commit builds were kicked off. The first was

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

2020-07-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167513#comment-17167513 ] Eric Payne commented on YARN-1529: -- [~Jim_Brennan], one thing I should point out is that the backports

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

2020-07-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167510#comment-17167510 ] Eric Payne commented on YARN-1529: -- Thanks for the updated patch, [~Jim_Brennan]. The changes LGTM,. +1

[jira] [Updated] (YARN-4575) ApplicationResourceUsageReport should return ALL reserved resource

2020-07-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4575: - Attachment: YARN-4575.004.patch > ApplicationResourceUsageReport should return ALL reserved resource >

[jira] [Commented] (YARN-1529) Add Localization overhead metrics to NM

2020-07-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167469#comment-17167469 ] Eric Payne commented on YARN-1529: -- bq. The TestContainerLaunch failures look like they are relevant. I

[jira] [Updated] (YARN-4575) ApplicationResourceUsageReport should return ALL reserved resource

2020-07-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4575: - Attachment: YARN-4575.003.patch > ApplicationResourceUsageReport should return ALL reserved resource >

[jira] [Commented] (YARN-10343) Legacy RM UI should include labeled metrics for allocated, total, and reserved resources.

2020-07-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167229#comment-17167229 ] Eric Payne commented on YARN-10343: --- Thank you very much [~jhung] and [~Jim_Brennan]! > Legacy RM UI

[jira] [Commented] (YARN-10343) Legacy RM UI should include labeled metrics for allocated, total, and reserved resources.

2020-07-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166524#comment-17166524 ] Eric Payne commented on YARN-10343: --- Thanks again, [~jhung] and [~Jim_Brennan] for the reviews and help

[jira] [Updated] (YARN-10343) Legacy RM UI should include labeled metrics for allocated, total, and reserved resources.

2020-07-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10343: -- Attachment: YARN-10343.branch-2.10.001.patch > Legacy RM UI should include labeled metrics for

[jira] [Commented] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-07-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17165954#comment-17165954 ] Eric Payne commented on YARN-10278: --- bq. So in my case as the trunk patch was uploaded before the

[jira] [Commented] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-07-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17165927#comment-17165927 ] Eric Payne commented on YARN-10278: --- bq. The new patch is only uploaded to trigger the build and have

[jira] [Updated] (YARN-10343) Legacy RM UI should include labeled metrics for allocated, total, and reserved resources.

2020-07-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10343: -- Attachment: YARN-10343.branch-3.2.001.patch > Legacy RM UI should include labeled metrics for

[jira] [Commented] (YARN-10343) Legacy RM UI should include labeled metrics for allocated, total, and reserved resources.

2020-07-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17165870#comment-17165870 ] Eric Payne commented on YARN-10343: --- Thanks [~jhung] and [~Jim_Brennan] for the reviews!. Sorry for the

[jira] [Commented] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-07-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17165831#comment-17165831 ] Eric Payne commented on YARN-10278: --- Also, [~snemeth] , I don't see a difference between the old 002

[jira] [Commented] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2020-07-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17165828#comment-17165828 ] Eric Payne commented on YARN-10278: --- [~snemeth], Thanks for working on this! bq. It seems like

[jira] [Resolved] (YARN-1741) XInclude support broken for YARN ResourceManager

2020-07-21 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved YARN-1741. -- Resolution: Won't Fix bq. Since branch-2.8 is EOL, I propose that we close this as Won't Fix. +1 >

  1   2   3   4   5   6   7   8   9   10   >