[jira] [Commented] (YARN-10855) yarn logs cli fails to retrieve logs if any TFile is corrupt or empty

2021-07-23 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17386458#comment-17386458 ] Jim Brennan commented on YARN-10855: Thanks [~zhuqi]! > yarn logs cli fails to retrieve logs if any

[jira] [Commented] (YARN-10855) yarn logs cli fails to retrieve logs if any TFile is corrupt or empty

2021-07-16 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382331#comment-17382331 ] Jim Brennan commented on YARN-10855: patch 003 fixes the checkstyle issues. [~epayne] can you please

[jira] [Updated] (YARN-10855) yarn logs cli fails to retrieve logs if any TFile is corrupt or empty

2021-07-16 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10855: --- Attachment: YARN-10855.003.patch > yarn logs cli fails to retrieve logs if any TFile is corrupt or

[jira] [Updated] (YARN-10855) yarn logs cli fails to retrieve logs if any TFile is corrupt or empty

2021-07-16 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10855: --- Attachment: YARN-10855.002.patch > yarn logs cli fails to retrieve logs if any TFile is corrupt or

[jira] [Commented] (YARN-10855) yarn logs cli fails to retrieve logs if any TFile is corrupt or empty

2021-07-16 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17382114#comment-17382114 ] Jim Brennan commented on YARN-10855: Thanks for the review and the suggestion [~zhuqi]! I will

[jira] [Updated] (YARN-10855) yarn logs cli fails to retrieve logs if any TFile is corrupt or empty

2021-07-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10855: --- Attachment: YARN-10855.001.patch > yarn logs cli fails to retrieve logs if any TFile is corrupt or

[jira] [Created] (YARN-10855) yarn logs cli fails to retrieve logs if any TFile is corrupt or empty

2021-07-15 Thread Jim Brennan (Jira)
Jim Brennan created YARN-10855: -- Summary: yarn logs cli fails to retrieve logs if any TFile is corrupt or empty Key: YARN-10855 URL: https://issues.apache.org/jira/browse/YARN-10855 Project: Hadoop YARN

[jira] [Assigned] (YARN-10855) yarn logs cli fails to retrieve logs if any TFile is corrupt or empty

2021-07-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned YARN-10855: -- Assignee: Jim Brennan > yarn logs cli fails to retrieve logs if any TFile is corrupt or empty

[jira] [Commented] (YARN-10456) RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry

2021-07-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17380864#comment-17380864 ] Jim Brennan commented on YARN-10456: Thanks [~epayne]!   The patch looks good and it matches the

[jira] [Assigned] (YARN-10542) Node Utilization on UI is misleading if nodes don't report utilization

2021-07-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned YARN-10542: -- Assignee: (was: Jim Brennan) > Node Utilization on UI is misleading if nodes don't report

[jira] [Updated] (YARN-10834) Intra-queue preemption: apps that don't use defined custom resource won't be preempted.

2021-06-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10834: --- Fix Version/s: 3.3.2 3.2.3 3.4.0 > Intra-queue preemption:

[jira] [Commented] (YARN-10834) Intra-queue preemption: apps that don't use defined custom resource won't be preempted.

2021-06-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370681#comment-17370681 ] Jim Brennan commented on YARN-10834: [~epayne], I have committed this to trunk - branch-3.2, but the

[jira] [Commented] (YARN-10834) Intra-queue preemption: apps that don't use defined custom resource won't be preempted.

2021-06-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17370641#comment-17370641 ] Jim Brennan commented on YARN-10834: Thanks for finding this and providing a fix! +1 The patch looks

[jira] [Commented] (YARN-10824) Title not set for JHS and NM webpages

2021-06-18 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17365674#comment-17365674 ] Jim Brennan commented on YARN-10824: Good catch!  One comment on the code: I'm not sure "{{About the

[jira] [Commented] (YARN-10767) Yarn Logs Command retrying on Standby RM for 30 times

2021-06-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17363205#comment-17363205 ] Jim Brennan commented on YARN-10767: Thanks for the update [~dmmkr]! I can see that you changed

[jira] [Commented] (YARN-10767) Yarn Logs Command retrying on Standby RM for 30 times

2021-06-10 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17361211#comment-17361211 ] Jim Brennan commented on YARN-10767: [~dmmkr] this looks good, but we should fix the spotbugs issue.

[jira] [Commented] (YARN-10767) Yarn Logs Command retrying on Standby RM for 30 times

2021-06-04 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357388#comment-17357388 ] Jim Brennan commented on YARN-10767: Thanks for your responses [~dmmkr]! Based on your reply, I am

[jira] [Commented] (YARN-10767) Yarn Logs Command retrying on Standby RM for 30 times

2021-06-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17355955#comment-17355955 ] Jim Brennan commented on YARN-10767: [~dmmkr], [~BilwaST], I am not familiar with the RM HA code, so

[jira] [Commented] (YARN-7713) Add parallel copying of directories into FSDownload

2021-05-27 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352688#comment-17352688 ] Jim Brennan commented on YARN-7713: --- I'm not convinced that this is a good idea at all, for several

[jira] [Commented] (YARN-10738) When multi thread scheduling with multi node, we should shuffle with a gap to prevent hot accessing nodes.

2021-04-28 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17335017#comment-17335017 ] Jim Brennan commented on YARN-10738: [~zhuqi], I am not very familiar with the multi-threaded

[jira] [Commented] (YARN-10743) Add a policy for not aggregating for containers which are killed because exceeding container log size limit.

2021-04-23 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17330998#comment-17330998 ] Jim Brennan commented on YARN-10743: [~zhuqi] thanks for updating the patch. I agree it would be

[jira] [Commented] (YARN-9594) Fix missing break statement in ContainerScheduler#handle

2021-04-23 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17330918#comment-17330918 ] Jim Brennan commented on YARN-9594: --- [~xiaoheipangzi] thanks for fixing this. I took the liberty of

[jira] [Updated] (YARN-9594) Fix missing break statement in ContainerScheduler#handle

2021-04-23 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-9594: -- Fix Version/s: 2.10.2 > Fix missing break statement in ContainerScheduler#handle >

[jira] [Commented] (YARN-10743) Add a policy for not aggregating for containers which are killed because exceeding container log size limit.

2021-04-23 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17330834#comment-17330834 ] Jim Brennan commented on YARN-10743: Thanks for the patch [~zhuqi]! The code looks good to me. Can

[jira] [Commented] (YARN-10743) Add a policy for not aggregating for containers which are killed because exceeding container log size limit.

2021-04-20 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326052#comment-17326052 ] Jim Brennan commented on YARN-10743: [~ebadger] I was going to say the same thing. I'm ok with this

[jira] [Commented] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2021-04-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17325332#comment-17325332 ] Jim Brennan commented on YARN-10460: +1 on the branch-2.10 patch. > Upgrading to JUnit 4.13 causes

[jira] [Commented] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2021-04-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17325278#comment-17325278 ] Jim Brennan commented on YARN-10460: +1 on the branch-3.2 patch. Looks good to me. > Upgrading to

[jira] [Commented] (YARN-10743) Add a policy for not aggregating for containers which are killed because exceeding container log size limit.

2021-04-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17325102#comment-17325102 ] Jim Brennan commented on YARN-10743: I don't think this is necessary. The logs may actually be

[jira] [Resolved] (YARN-10733) TimelineService Hbase tests are failing with timeout error on branch-2.10

2021-04-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved YARN-10733. Fix Version/s: 2.10.2 Resolution: Fixed Thanks [~ahussein], I have committed this to

[jira] [Commented] (YARN-10733) TimelineService Hbase tests are failing with timeout error on branch-2.10

2021-04-14 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321237#comment-17321237 ] Jim Brennan commented on YARN-10733: [~ahussein] reached out to our Hbase team, and they did not have

[jira] [Commented] (YARN-10733) TimelineService Hbase tests are failing with timeout error on branch-2.10

2021-04-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320278#comment-17320278 ] Jim Brennan commented on YARN-10733: It looks like the fix is to change

[jira] [Commented] (YARN-10475) Scale RM-NM heartbeat interval based on node utilization

2021-04-07 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316489#comment-17316489 ] Jim Brennan commented on YARN-10475: [~chaosju] thanks for your comment. The implementation we

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-04-07 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316478#comment-17316478 ] Jim Brennan commented on YARN-10702: Thanks again [~ebadger]! I put up additional patches for

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-04-07 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: YARN-10702-branch-3.2.006.patch > Add cluster metric for amount of CPU used by RM Event

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-04-07 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: YARN-10702-branch-3.1.006.patch > Add cluster metric for amount of CPU used by RM Event

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-04-06 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315597#comment-17315597 ] Jim Brennan commented on YARN-10702: The failed unit test for branch-3.3 is unrelated. Looks like it

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-04-05 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17315196#comment-17315196 ] Jim Brennan commented on YARN-10702: Thanks [~ebadger]! I have put up a patch for branch-3.3. > Add

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-04-05 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: YARN-10702-branch-3.3.006.patch > Add cluster metric for amount of CPU used by RM Event

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-04-05 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314912#comment-17314912 ] Jim Brennan commented on YARN-10702: Not going to fix these checkstyle issues, because the new

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-04-04 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314651#comment-17314651 ] Jim Brennan commented on YARN-10702: patch 006 addresses the checkstyle/spotbug issues. > Add

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-04-04 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: YARN-10702.006.patch > Add cluster metric for amount of CPU used by RM Event Processor >

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-04-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314086#comment-17314086 ] Jim Brennan commented on YARN-10702: Patch 005 adds a configuration property for this: {noformat}

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-04-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: YARN-10702.005.patch > Add cluster metric for amount of CPU used by RM Event Processor >

[jira] [Commented] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

2021-03-23 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307114#comment-17307114 ] Jim Brennan commented on YARN-10697: Thanks for the update [~BilwaST]! I am +1 on patch 003.

[jira] [Comment Edited] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

2021-03-22 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306489#comment-17306489 ] Jim Brennan edited comment on YARN-10697 at 3/22/21, 7:02 PM: -- Thanks for

[jira] [Commented] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

2021-03-22 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17306489#comment-17306489 ] Jim Brennan commented on YARN-10697: Thanks for the update [~BilwaST]! +1 patch 002 looks good to

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17305110#comment-17305110 ] Jim Brennan commented on YARN-10702: Thanks for the suggestions [~gandras]! I agree this should be

[jira] [Commented] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

2021-03-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304941#comment-17304941 ] Jim Brennan commented on YARN-10697: {quote} So can we introduce a new method in Resource.java which

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-18 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: YARN-10702.004.patch > Add cluster metric for amount of CPU used by RM Event Processor >

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-18 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304250#comment-17304250 ] Jim Brennan commented on YARN-10702: Jumped the gun. Patch 004 has fixes for the other checkstyle

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-18 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304240#comment-17304240 ] Jim Brennan commented on YARN-10702: Thanks for the review [~zhuqi]! patch 003 fixes the method

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-18 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: YARN-10702.003.patch > Add cluster metric for amount of CPU used by RM Event Processor >

[jira] [Commented] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

2021-03-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303747#comment-17303747 ] Jim Brennan commented on YARN-10697: [~BilwaST] I agree about the bug in

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303724#comment-17303724 ] Jim Brennan commented on YARN-10702: patch 002 is rebased to current trunk. > Add cluster metric for

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: YARN-10702.002.patch > Add cluster metric for amount of CPU used by RM Event Processor >

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: Scheduler-Busy.png > Add cluster metric for amount of CPU used by RM Event Processor >

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: simon-scheduler-busy.png > Add cluster metric for amount of CPU used by RM Event

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303697#comment-17303697 ] Jim Brennan commented on YARN-10702: Attaching some images of how this looks on the RM legacy UI and

[jira] [Updated] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10702: --- Attachment: YARN-10702.001.patch > Add cluster metric for amount of CPU used by RM Event Processor >

[jira] [Created] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-17 Thread Jim Brennan (Jira)
Jim Brennan created YARN-10702: -- Summary: Add cluster metric for amount of CPU used by RM Event Processor Key: YARN-10702 URL: https://issues.apache.org/jira/browse/YARN-10702 Project: Hadoop YARN

[jira] [Commented] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-03-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300968#comment-17300968 ] Jim Brennan commented on YARN-10588: Yes.  I think it is ok to do it as a separate Jira.  We may

[jira] [Commented] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

2021-03-12 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300369#comment-17300369 ] Jim Brennan commented on YARN-10687: Thanks for the updates [~zhuqi]!  I am +1 on patch 004.   I will

[jira] [Commented] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

2021-03-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299827#comment-17299827 ] Jim Brennan commented on YARN-10687: Thanks for updating [~zhuqi]!  Can you please add a unit test to

[jira] [Commented] (YARN-10688) ClusterMetrics should support GPU related metrics.

2021-03-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299638#comment-17299638 ] Jim Brennan commented on YARN-10688: [~zhuqi] we are very interested in this feature. [~ebadger] can

[jira] [Commented] (YARN-10687) Add option to disable/enable free disk space checking and percentage checking for full and not-full disks

2021-03-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17299613#comment-17299613 ] Jim Brennan commented on YARN-10687: Thanks [~zhuqi]! These are not strictly needed, because the

[jira] [Commented] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-03-10 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298991#comment-17298991 ] Jim Brennan commented on YARN-10588: This looks good, but I have one question about

[jira] [Commented] (YARN-10664) Allow parameter expansion in NM_ADMIN_USER_ENV

2021-03-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297701#comment-17297701 ] Jim Brennan commented on YARN-10664: Thanks for the reviews and the commits [~ebadger]! > Allow

[jira] [Commented] (YARN-10664) Allow parameter expansion in NM_ADMIN_USER_ENV

2021-03-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297522#comment-17297522 ] Jim Brennan commented on YARN-10664: Thanks [~ebadger]! I have put up a patch for branch-3.2.I'm

[jira] [Updated] (YARN-10664) Allow parameter expansion in NM_ADMIN_USER_ENV

2021-03-08 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10664: --- Attachment: YARN-10664-branch-3.2.004.patch > Allow parameter expansion in NM_ADMIN_USER_ENV >

[jira] [Commented] (YARN-8786) LinuxContainerExecutor fails sporadically in create_local_dirs

2021-03-05 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296093#comment-17296093 ] Jim Brennan commented on YARN-8786: --- I am ok with closing it. > LinuxContainerExecutor fails

[jira] [Commented] (YARN-10664) Allow parameter expansion in NM_ADMIN_USER_ENV

2021-03-04 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295623#comment-17295623 ] Jim Brennan commented on YARN-10664: Thanks for the review [~ebadger]! I have put up patch 004 to

[jira] [Updated] (YARN-10664) Allow parameter expansion in NM_ADMIN_USER_ENV

2021-03-04 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10664: --- Attachment: YARN-10664.004.patch > Allow parameter expansion in NM_ADMIN_USER_ENV >

[jira] [Commented] (YARN-10664) Allow parameter expansion in NM_ADMIN_USER_ENV

2021-03-04 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295589#comment-17295589 ] Jim Brennan commented on YARN-10664: It would have to be an environment variable that contains a

[jira] [Commented] (YARN-10665) TestContainerManagerRecovery sometimes fails

2021-03-04 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295541#comment-17295541 ] Jim Brennan commented on YARN-10665: I am going to close this as invalid. I have not been able to

[jira] [Updated] (YARN-10664) Allow parameter expansion in NM_ADMIN_USER_ENV

2021-03-04 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10664: --- Attachment: YARN-10664.003.patch > Allow parameter expansion in NM_ADMIN_USER_ENV >

[jira] [Commented] (YARN-10664) Allow parameter expansion in NM_ADMIN_USER_ENV

2021-03-04 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295518#comment-17295518 ] Jim Brennan commented on YARN-10664: Trying to put up patch 003, which is identical to patch 002, to

[jira] [Updated] (YARN-10665) TestContainerManagerRecovery sometimes fails

2021-03-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10665: --- Summary: TestContainerManagerRecovery sometimes fails (was: TestContainerManagerRecover sometimes

[jira] [Commented] (YARN-10664) Allow parameter expansion in NM_ADMIN_USER_ENV

2021-03-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294032#comment-17294032 ] Jim Brennan commented on YARN-10664: Thanks for the review [~ebadger]! I put up patch 002 to remove

[jira] [Created] (YARN-10665) TestContainerManagerRecover sometimes fails

2021-03-02 Thread Jim Brennan (Jira)
Jim Brennan created YARN-10665: -- Summary: TestContainerManagerRecover sometimes fails Key: YARN-10665 URL: https://issues.apache.org/jira/browse/YARN-10665 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-10664) Allow parameter expansion in NM_ADMIN_USER_ENV

2021-03-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10664: --- Attachment: YARN-10664.002.patch > Allow parameter expansion in NM_ADMIN_USER_ENV >

[jira] [Updated] (YARN-10664) Allow parameter expansion in NM_ADMIN_USER_ENV

2021-03-02 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10664: --- Attachment: YARN-10664.001.patch > Allow parameter expansion in NM_ADMIN_USER_ENV >

[jira] [Created] (YARN-10664) Allow parameter expansion in NM_ADMIN_USER_ENV

2021-03-02 Thread Jim Brennan (Jira)
Jim Brennan created YARN-10664: -- Summary: Allow parameter expansion in NM_ADMIN_USER_ENV Key: YARN-10664 URL: https://issues.apache.org/jira/browse/YARN-10664 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-25 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291064#comment-17291064 ] Jim Brennan commented on YARN-10613: [~epayne], I have committed to trunk and branch-3.3, but the

[jira] [Commented] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-24 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290520#comment-17290520 ] Jim Brennan commented on YARN-10613: Thanks for the update [~epayne].  This looks good to me.  +1 on

[jira] [Commented] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-24 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290079#comment-17290079 ] Jim Brennan commented on YARN-10613: Thanks [~epayne]! The patch looks good to me but for two minor

[jira] [Commented] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-23 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289400#comment-17289400 ] Jim Brennan commented on YARN-10613: I think you should stick with

[jira] [Commented] (YARN-10613) Config to allow Intra- and Inter-queue preemption to enable/disable conservativeDRF

2021-02-23 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289325#comment-17289325 ] Jim Brennan commented on YARN-10613: I like your proposal for the more easily distinguished property

[jira] [Commented] (YARN-10626) Log resource allocation in NM log at container start time

2021-02-16 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17285299#comment-17285299 ] Jim Brennan commented on YARN-10626: +1. This looks good to me [~ebadger]! I agree we don't need a

[jira] [Resolved] (YARN-5853) TestDelegationTokenRenewer#testRMRestartWithExpiredToken fails intermittently on Power

2021-02-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-5853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan resolved YARN-5853. --- Resolution: Duplicate This is fixed by YARN-10500 >

[jira] [Commented] (YARN-10500) TestDelegationTokenRenewer fails intermittently

2021-02-11 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283357#comment-17283357 ] Jim Brennan commented on YARN-10500: Thanks for the update [~iwasakims]! I have committed to trunk

[jira] [Commented] (YARN-10500) TestDelegationTokenRenewer fails intermittently

2021-02-10 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282670#comment-17282670 ] Jim Brennan commented on YARN-10500: Actually I missed noticing there were some check-style issues.

[jira] [Commented] (YARN-10500) TestDelegationTokenRenewer fails intermittently

2021-02-10 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282664#comment-17282664 ] Jim Brennan commented on YARN-10500: +1 Thanks for fixing this [~iwasakims]! I will commit shortly.

[jira] [Commented] (YARN-10588) Percentage of queue and cluster is zero in WebUI

2021-02-05 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279997#comment-17279997 ] Jim Brennan commented on YARN-10588: Thanks for reporting this and putting up the patch [~BilwaST]!

[jira] [Commented] (YARN-10607) User environment is unable to prepend PATH when mapreduce.admin.user.env also sets PATH

2021-02-05 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279810#comment-17279810 ] Jim Brennan commented on YARN-10607: Thanks for the updates [~ebadger]. +1 This looks good to me. I

[jira] [Commented] (YARN-10607) User environment is unable to prepend PATH when mapreduce.admin.user.env also sets PATH

2021-02-04 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279200#comment-17279200 ] Jim Brennan commented on YARN-10607: Thanks [~ebadger]. This looks good overall, but I have one

[jira] [Commented] (YARN-10607) User environment is unable to prepend PATH when mapreduce.admin.user.env also sets PATH

2021-02-04 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279016#comment-17279016 ] Jim Brennan commented on YARN-10607: Thanks [~ebadger]! Patch 002 seems to have an extraneous change

[jira] [Commented] (YARN-10613) Config to allow Intra-queue preemption to enable/disable conservativeDRF

2021-02-03 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278349#comment-17278349 ] Jim Brennan commented on YARN-10613: [~epayne] any reason we shouldn't add a property for

[jira] [Commented] (YARN-10562) Follow up changes for YARN-9833

2021-01-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17267945#comment-17267945 ] Jim Brennan commented on YARN-10562: Thanks [~ebadger]! > Follow up changes for YARN-9833 >

[jira] [Commented] (YARN-10562) Follow up changes for YARN-9833

2021-01-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17266098#comment-17266098 ] Jim Brennan commented on YARN-10562: Given that the original bug exists in branch-2 as well, I think

[jira] [Commented] (YARN-4589) Diagnostics for localization timeouts is lacking

2021-01-13 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-4589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17264327#comment-17264327 ] Jim Brennan commented on YARN-4589: --- [~epayne], I have attached a patch for branch-3.2.  I have also

  1   2   3   4   5   6   7   8   9   >