[jira] [Comment Edited] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17334565#comment-17334565 ] Qi Zhu edited comment on YARN-9927 at 4/28/21, 8:29 AM: [~ebadger]

[jira] [Commented] (YARN-10707) Support custom resources in ResourceUtilization, and update Node GPU Utilization to use.

[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17334606#comment-17334606 ] Qi Zhu commented on YARN-10707: --- Fixed java doc in latest patch. > Support custom resource

[jira] [Updated] (YARN-10707) Support custom resources in ResourceUtilization, and update Node GPU Utilization to use.

[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10707: -- Attachment: YARN-10707.011.patch > Support custom resources in ResourceUtilization, and update Node GPU > Util

[jira] [Commented] (YARN-10707) Support custom resources in ResourceUtilization, and update Node GPU Utilization to use.

[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17334756#comment-17334756 ] Qi Zhu commented on YARN-10707: --- The failed time out test is not related, passed locally.

[jira] [Commented] (YARN-10738) When multi thread scheduling with multi node, we should shuffle with a gap to prevent hot accessing nodes.

[ https://issues.apache.org/jira/browse/YARN-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17335104#comment-17335104 ] Qi Zhu commented on YARN-10738: --- Thanks [~Jim_Brennan] for review and very patient investig

[jira] [Comment Edited] (YARN-10738) When multi thread scheduling with multi node, we should shuffle with a gap to prevent hot accessing nodes.

[ https://issues.apache.org/jira/browse/YARN-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17335104#comment-17335104 ] Qi Zhu edited comment on YARN-10738 at 4/29/21, 2:45 AM: - Thanks

[jira] [Comment Edited] (YARN-10738) When multi thread scheduling with multi node, we should shuffle with a gap to prevent hot accessing nodes.

[ https://issues.apache.org/jira/browse/YARN-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17335104#comment-17335104 ] Qi Zhu edited comment on YARN-10738 at 4/29/21, 2:46 AM: - Thanks

[jira] [Comment Edited] (YARN-10738) When multi thread scheduling with multi node, we should shuffle with a gap to prevent hot accessing nodes.

[ https://issues.apache.org/jira/browse/YARN-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17335104#comment-17335104 ] Qi Zhu edited comment on YARN-10738 at 4/29/21, 2:48 AM: - Thanks

[jira] [Commented] (YARN-9443) Fast RM Failover using Ratis (Raft protocol)

[ https://issues.apache.org/jira/browse/YARN-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17335205#comment-17335205 ] Qi Zhu commented on YARN-9443: -- [~prabhujoseph] [~ztang] [~ebadger] [~epayne] Is this going

[jira] [Commented] (YARN-10592) Support QueueCapacities to use vector based multi resource types, and update absolute related to use first.

[ https://issues.apache.org/jira/browse/YARN-10592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17339375#comment-17339375 ] Qi Zhu commented on YARN-10592: --- [~gandras] I think  YARN-9936 would cover this. > Suppor

[jira] [Commented] (YARN-10524) Support multi resource type based weight mode in CS.

[ https://issues.apache.org/jira/browse/YARN-10524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17339376#comment-17339376 ] Qi Zhu commented on YARN-10524: --- Thanks [~gandras] for concern.  I think YARN-9936 will co

[jira] [Commented] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17339378#comment-17339378 ] Qi Zhu commented on YARN-10517: --- Thanks [~zhanqi.cai] for report. Could you apply the late

[jira] [Commented] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17339383#comment-17339383 ] Qi Zhu commented on YARN-9927: -- Great review and investigation! Thanks very much  [~ebadger]

[jira] [Comment Edited] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17339383#comment-17339383 ] Qi Zhu edited comment on YARN-9927 at 5/5/21, 3:05 AM: --- Great review

[jira] [Comment Edited] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17339383#comment-17339383 ] Qi Zhu edited comment on YARN-9927 at 5/6/21, 6:41 AM: --- Great review

[jira] [Created] (YARN-10761) Add more event type to RM Dispatcher event metrics.

Qi Zhu created YARN-10761: - Summary: Add more event type to RM Dispatcher event metrics. Key: YARN-10761 URL: https://issues.apache.org/jira/browse/YARN-10761 Project: Hadoop YARN Issue Type: Sub-tas

[jira] [Updated] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10761: -- Attachment: image-2021-05-06-16-38-51-406.png > Add more event type to RM Dispatcher event metrics. > -

[jira] [Updated] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10761: -- Attachment: image-2021-05-06-16-39-28-362.png > Add more event type to RM Dispatcher event metrics. > -

[jira] [Commented] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340081#comment-17340081 ] Qi Zhu commented on YARN-10761: --- [~ebadger] [~pbacsko] [~gandras] [~bilwa_st] Could you he

[jira] [Updated] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10761: -- Attachment: YARN-10761.002.patch > Add more event type to RM Dispatcher event metrics. > --

[jira] [Commented] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340529#comment-17340529 ] Qi Zhu commented on YARN-10761: --- Thanks a lot [~ebadger] for review. I have changed the tw

[jira] [Commented] (YARN-10755) Multithreaded loading Apps from zk statestore

[ https://issues.apache.org/jira/browse/YARN-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340570#comment-17340570 ] Qi Zhu commented on YARN-10755: --- Thanks [~chaosju] report , and [~BilwaST] for taking this.

[jira] [Updated] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10761: -- Attachment: YARN-10761.003.patch > Add more event type to RM Dispatcher event metrics. > --

[jira] [Commented] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340582#comment-17340582 ] Qi Zhu commented on YARN-10761: --- Fixed checkstyle in latest patch. > Add more event type t

[jira] [Commented] (YARN-10738) When multi thread scheduling with multi node, we should shuffle with a gap to prevent hot accessing nodes.

[ https://issues.apache.org/jira/browse/YARN-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340599#comment-17340599 ] Qi Zhu commented on YARN-10738: --- Thanks a lot [~bibinchundatt] for reply and value informat

[jira] [Commented] (YARN-10763) add the speed of containers assigned metrics to ClusterMetrics

[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17340883#comment-17340883 ] Qi Zhu commented on YARN-10763: --- Thanks [~chaosju] for report. If you can use aggregateCon

[jira] [Created] (YARN-10764) Add rm dispatcher event metrics in SLS

Qi Zhu created YARN-10764: - Summary: Add rm dispatcher event metrics in SLS Key: YARN-10764 URL: https://issues.apache.org/jira/browse/YARN-10764 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-10764) Add rm dispatcher event metrics in SLS

[ https://issues.apache.org/jira/browse/YARN-10764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10764: -- Description: We should use SLS to confirm if we can get performance improvement of event consume time etc. > A

[jira] [Commented] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17341986#comment-17341986 ] Qi Zhu commented on YARN-10761: --- Thanks [~gandras] for your review.  > Add more event type

[jira] [Commented] (YARN-10759) Encapsulate queue config modes

[ https://issues.apache.org/jira/browse/YARN-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17342269#comment-17342269 ] Qi Zhu commented on YARN-10759: --- Thanks [~gandras] for this work. Very good work, i am ver

[jira] [Commented] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17343084#comment-17343084 ] Qi Zhu commented on YARN-10517: --- Thanks [~zhanqi.cai] for confirm. cc [~pbacsko]  [~ebadge

[jira] [Commented] (YARN-10632) Make maximum depth allowed configurable.

[ https://issues.apache.org/jira/browse/YARN-10632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17343750#comment-17343750 ] Qi Zhu commented on YARN-10632: --- Thanks [~gandras] for reminder. I will change it based YA

[jira] [Commented] (YARN-10632) Make maximum depth allowed configurable.

[ https://issues.apache.org/jira/browse/YARN-10632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17343782#comment-17343782 ] Qi Zhu commented on YARN-10632: --- [~gandras]  I have updated it in latest patch. > Make ma

[jira] [Updated] (YARN-10632) Make maximum depth allowed configurable.

[ https://issues.apache.org/jira/browse/YARN-10632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10632: -- Attachment: YARN-10632.003.patch > Make maximum depth allowed configurable. > -

[jira] [Updated] (YARN-10632) Make maximum depth allowed configurable.

[ https://issues.apache.org/jira/browse/YARN-10632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10632: -- Attachment: YARN-10632.004.patch > Make maximum depth allowed configurable. > -

[jira] [Commented] (YARN-10632) Make maximum depth allowed configurable.

[ https://issues.apache.org/jira/browse/YARN-10632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17343950#comment-17343950 ] Qi Zhu commented on YARN-10632: --- Fixed the checkstyle and java doc in latest patch. > Make

[jira] [Commented] (YARN-10737) Fix typos in CapacityScheduler#schedule.

[ https://issues.apache.org/jira/browse/YARN-10737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344319#comment-17344319 ] Qi Zhu commented on YARN-10737: --- Thanks [~hexiaoqiao]  [@fdalsotto|https://github.com/fdals

[jira] [Commented] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344372#comment-17344372 ] Qi Zhu commented on YARN-10761: --- Thanks [~ebadger] [~gandras]  [~chaosju] for review. Merg

[jira] [Commented] (YARN-10766) [UI2] Bump moment-timezone to 0.5.33

[ https://issues.apache.org/jira/browse/YARN-10766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344462#comment-17344462 ] Qi Zhu commented on YARN-10766: --- Thanks [~gandras] for patch. LGTM +1 > [UI2] Bump moment

[jira] [Assigned] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reassigned YARN-10324: - Assignee: Yao Guangdong > Fetch data from NodeManager may case read timeout when disk is busy >

[jira] [Commented] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344478#comment-17344478 ] Qi Zhu commented on YARN-10324: --- Hi [~yaoguangdong]  Thanks for this work. I have added yo

[jira] [Comment Edited] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344478#comment-17344478 ] Qi Zhu edited comment on YARN-10324 at 5/14/21, 9:01 AM: - Hi [~ya

[jira] [Commented] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344483#comment-17344483 ] Qi Zhu commented on YARN-10761: --- Thanks [~snemeth] for reminder. Sorry for the commit. The

[jira] [Comment Edited] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344483#comment-17344483 ] Qi Zhu edited comment on YARN-10761 at 5/14/21, 9:16 AM: - Thanks

[jira] [Comment Edited] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344483#comment-17344483 ] Qi Zhu edited comment on YARN-10761 at 5/14/21, 9:19 AM: - Thanks

[jira] [Comment Edited] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344483#comment-17344483 ] Qi Zhu edited comment on YARN-10761 at 5/14/21, 9:26 AM: - Thanks

[jira] [Commented] (YARN-10764) Add rm dispatcher event metrics in SLS

[ https://issues.apache.org/jira/browse/YARN-10764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344490#comment-17344490 ] Qi Zhu commented on YARN-10764: --- I think we should add the event related metrics to SLS, su

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344531#comment-17344531 ] Qi Zhu commented on YARN-9615: -- [~chaosju] Sure.:D > Add dispatcher metrics to RM >

[jira] [Commented] (YARN-9698) [Umbrella] Tools to help migration from Fair Scheduler to Capacity Scheduler

[ https://issues.apache.org/jira/browse/YARN-9698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17344630#comment-17344630 ] Qi Zhu commented on YARN-9698: -- Thanks [~pbacsko] for reminder. I agree with you that we can

[jira] [Assigned] (YARN-10545) Improve the readability of diagnostics log in yarn-ui2 web page.

[ https://issues.apache.org/jira/browse/YARN-10545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reassigned YARN-10545: - Assignee: akiyamaneko > Improve the readability of diagnostics log in yarn-ui2 web page. > -

[jira] [Resolved] (YARN-10545) Improve the readability of diagnostics log in yarn-ui2 web page.

[ https://issues.apache.org/jira/browse/YARN-10545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu resolved YARN-10545. --- Fix Version/s: 3.4.0 Resolution: Fixed > Improve the readability of diagnostics log in yarn-ui2 web pa

[jira] [Commented] (YARN-10763) add the speed of containers assigned metrics to ClusterMetrics

[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345849#comment-17345849 ] Qi Zhu commented on YARN-10763: --- Thanks [~chaosju] for update. The latest patch LGTM +1.

[jira] [Commented] (YARN-10555) missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17345995#comment-17345995 ] Qi Zhu commented on YARN-10555: --- It was merged by [~aajisaka] , i just make it fixed. Than

[jira] [Commented] (YARN-10555) Missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17346018#comment-17346018 ] Qi Zhu commented on YARN-10555: --- Thanks [~aajisaka] for backport. > Missing access check

[jira] [Commented] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17346181#comment-17346181 ] Qi Zhu commented on YARN-10771: --- Thanks [~chaosju] for this. This is useful for user to kn

[jira] [Commented] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17346575#comment-17346575 ] Qi Zhu commented on YARN-10771: --- Thanks [~chaosju] for patch. I think we should change:"rm

[jira] [Comment Edited] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17346575#comment-17346575 ] Qi Zhu edited comment on YARN-10771 at 5/18/21, 3:59 AM: - Thanks

[jira] [Reopened] (YARN-8564) Add queue level application lifetime monitor in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reopened YARN-8564: -- > Add queue level application lifetime monitor in FairScheduler > -

[jira] [Commented] (YARN-8564) Add queue level application lifetime monitor in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17346911#comment-17346911 ] Qi Zhu commented on YARN-8564: -- Thanks [~tarunparimi] for reminder. I reopened it, you can t

[jira] [Commented] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17347005#comment-17347005 ] Qi Zhu commented on YARN-10771: --- Thanks [~chaosju] for update. The patch LGTM, go on to fi

[jira] [Commented] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17347313#comment-17347313 ] Qi Zhu commented on YARN-10771: --- Thanks [~chaosju] for update. The patch LGTM now. Waitin

[jira] [Commented] (YARN-10774) Federation: Normalize the yarn federation queue name

[ https://issues.apache.org/jira/browse/YARN-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17347427#comment-17347427 ] Qi Zhu commented on YARN-10774: --- [~luoyuan] Now fs support both root.XXX and xxx but cs sti

[jira] [Comment Edited] (YARN-10774) Federation: Normalize the yarn federation queue name

[ https://issues.apache.org/jira/browse/YARN-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17347427#comment-17347427 ] Qi Zhu edited comment on YARN-10774 at 5/19/21, 9:01 AM: - [~luoyu

[jira] [Reopened] (YARN-10701) The yarn.resource-types should support multi types without trimmed.

[ https://issues.apache.org/jira/browse/YARN-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reopened YARN-10701: --- > The yarn.resource-types should support multi types without trimmed. > -

[jira] [Commented] (YARN-10701) The yarn.resource-types should support multi types without trimmed.

[ https://issues.apache.org/jira/browse/YARN-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17347438#comment-17347438 ] Qi Zhu commented on YARN-10701: --- Thanks [~weichiu] for reminder. I will help to backport t

[jira] [Commented] (YARN-10701) The yarn.resource-types should support multi types without trimmed.

[ https://issues.apache.org/jira/browse/YARN-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17347445#comment-17347445 ] Qi Zhu commented on YARN-10701: --- Submitted backport-3.3 patch to trigger jenkins. > The ya

[jira] [Commented] (YARN-10701) The yarn.resource-types should support multi types without trimmed.

[ https://issues.apache.org/jira/browse/YARN-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17347679#comment-17347679 ] Qi Zhu commented on YARN-10701: --- The test is not related this jira. Committed to branch-3.

[jira] [Comment Edited] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17347313#comment-17347313 ] Qi Zhu edited comment on YARN-10771 at 5/20/21, 2:29 AM: - Thanks

[jira] [Commented] (YARN-10543) Timeline Server V1.5 not supporting audit log

[ https://issues.apache.org/jira/browse/YARN-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17348066#comment-17348066 ] Qi Zhu commented on YARN-10543: --- Thanks [~gb.ana...@gmail.com] for patch. The patch genera

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17348941#comment-17348941 ] Qi Zhu commented on YARN-10779: --- Thanks [~pbacsko] for this work. The patch LGTM, just to

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17349052#comment-17349052 ] Qi Zhu commented on YARN-10779: --- Thanks [~gandras] for reminder. If we should enable use t

[jira] [Commented] (YARN-10781) The Thread of the NM aggregate log is exhausted and no other Application can aggregate the log

[ https://issues.apache.org/jira/browse/YARN-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17349065#comment-17349065 ] Qi Zhu commented on YARN-10781: --- Thanks [~zhangxiping] for this. If you mean when the Spar

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17349073#comment-17349073 ] Qi Zhu commented on YARN-10779: --- Thanks [~pbacsko] for reply. I also agree that it only af

[jira] [Commented] (YARN-10657) We should make max application per queue to support node label.

[ https://issues.apache.org/jira/browse/YARN-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17349094#comment-17349094 ] Qi Zhu commented on YARN-10657: --- Thanks [~gandras] for reply. We now can close before we c

[jira] [Updated] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10324: -- Attachment: image-2021-05-21-17-48-03-476.png > Fetch data from NodeManager may case read timeout when disk is

[jira] [Commented] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17349111#comment-17349111 ] Qi Zhu commented on YARN-10324: --- [~yaoguangdong] You should submitted it, make it patch ava

[jira] [Commented] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17349124#comment-17349124 ] Qi Zhu commented on YARN-10324: --- [~yaoguangdong] I'm not sure if you removed the original 0

[jira] [Commented] (YARN-10781) The Thread of the NM aggregate log is exhausted and no other Application can aggregate the log

[ https://issues.apache.org/jira/browse/YARN-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17350255#comment-17350255 ] Qi Zhu commented on YARN-10781: --- [~zhangxiping] It only init app and create the thread poo

[jira] [Comment Edited] (YARN-10781) The Thread of the NM aggregate log is exhausted and no other Application can aggregate the log

[ https://issues.apache.org/jira/browse/YARN-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17350255#comment-17350255 ] Qi Zhu edited comment on YARN-10781 at 5/24/21, 6:02 AM: - [~zhang

[jira] [Commented] (YARN-10783) Allow definition of auto queue template properties in root

[ https://issues.apache.org/jira/browse/YARN-10783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17350262#comment-17350262 ] Qi Zhu commented on YARN-10783: --- Thanks [~gandras] for this. The patch LGTM +1. > Allow d

[jira] [Commented] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17350482#comment-17350482 ] Qi Zhu commented on YARN-10771: --- Thanks [~chaosju] for contribution and [~pbacsko] for revi

[jira] [Created] (YARN-10785) Yarn NodeManager aux-services should support trim.

Qi Zhu created YARN-10785: - Summary: Yarn NodeManager aux-services should support trim. Key: YARN-10785 URL: https://issues.apache.org/jira/browse/YARN-10785 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-10770) container-executor permission is wrong in SecureContainer.md

[ https://issues.apache.org/jira/browse/YARN-10770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17350807#comment-17350807 ] Qi Zhu commented on YARN-10770: --- Thanks [~aajisaka] for good finding, [~sahuja] for patch.

[jira] [Commented] (YARN-10786) Federation:We can't access the AM page while using federation

[ https://issues.apache.org/jira/browse/YARN-10786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17350861#comment-17350861 ] Qi Zhu commented on YARN-10786: --- Thanks [~Song Jiacheng] for report this. Can you add some

[jira] [Commented] (YARN-10786) Federation:We can't access the AM page while using federation

[ https://issues.apache.org/jira/browse/YARN-10786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17350939#comment-17350939 ] Qi Zhu commented on YARN-10786: --- Thanks [~Song Jiacheng] for contribution. The patch LGTM.

[jira] [Commented] (YARN-10781) The Thread of the NM aggregate log is exhausted and no other Application can aggregate the log

[ https://issues.apache.org/jira/browse/YARN-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17351456#comment-17351456 ] Qi Zhu commented on YARN-10781: --- [~zhangxiping] If you enabled rolling log aggregation for

[jira] [Commented] (YARN-10795) Improve Capacity Scheduler reinitialisation performance

[ https://issues.apache.org/jira/browse/YARN-10795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17354809#comment-17354809 ] Qi Zhu commented on YARN-10795: --- Thanks [~gandras] for this work. It will be very helpful

[jira] [Assigned] (YARN-10522) Document for Flexible Auto Queue Creation in Capacity Scheduler.

[ https://issues.apache.org/jira/browse/YARN-10522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reassigned YARN-10522: - Assignee: (was: Ankit Kumar) > Document for Flexible Auto Queue Creation in Capacity Scheduler. > --

[jira] [Assigned] (YARN-10522) Document for Flexible Auto Queue Creation in Capacity Scheduler.

[ https://issues.apache.org/jira/browse/YARN-10522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reassigned YARN-10522: - Assignee: Benjamin Teke > Document for Flexible Auto Queue Creation in Capacity Scheduler. > ---

[jira] [Commented] (YARN-10522) Document for Flexible Auto Queue Creation in Capacity Scheduler.

[ https://issues.apache.org/jira/browse/YARN-10522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17356213#comment-17356213 ] Qi Zhu commented on YARN-10522: --- Thanks for [~bteke] taking this. I assigned it to you.  

[jira] [Commented] (YARN-10796) Capacity Scheduler: dynamic queue cannot scale out properly if its capacity is 0%

[ https://issues.apache.org/jira/browse/YARN-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17356214#comment-17356214 ] Qi Zhu commented on YARN-10796: --- Thanks [~pbacsko] the latest patch LGTM +1. And i agree w

[jira] [Commented] (YARN-10789) RM HA startup can fail due to race conditions in ZKConfigurationStore

[ https://issues.apache.org/jira/browse/YARN-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17356504#comment-17356504 ] Qi Zhu commented on YARN-10789: --- Thanks [~tarunparimi] for this work. The latest patch LGT

[jira] [Commented] (YARN-10807) Parents node labels are incorrectly added to child queues in weight mode

[ https://issues.apache.org/jira/browse/YARN-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358486#comment-17358486 ] Qi Zhu commented on YARN-10807: --- Thanks [~bteke] for this work. If we can skip the not exi

[jira] [Comment Edited] (YARN-10807) Parents node labels are incorrectly added to child queues in weight mode

[ https://issues.apache.org/jira/browse/YARN-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358486#comment-17358486 ] Qi Zhu edited comment on YARN-10807 at 6/7/21, 9:54 AM: Thanks [~

[jira] [Commented] (YARN-10807) Parents node labels are incorrectly added to child queues in weight mode

[ https://issues.apache.org/jira/browse/YARN-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17358980#comment-17358980 ] Qi Zhu commented on YARN-10807: --- Thanks [~bteke] for update. The patch LGTM.   > Parents

[jira] [Commented] (YARN-10807) Parents node labels are incorrectly added to child queues in weight mode

[ https://issues.apache.org/jira/browse/YARN-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359343#comment-17359343 ] Qi Zhu commented on YARN-10807: --- Thanks [~bteke] for patch and [~gandras] for review. Comm

[jira] [Commented] (YARN-10801) Fix Auto Queue template to properly set all configuration properties

[ https://issues.apache.org/jira/browse/YARN-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359366#comment-17359366 ] Qi Zhu commented on YARN-10801: --- Thanks [~gandras] for patch LGTM now. I have a question

[jira] [Comment Edited] (YARN-10801) Fix Auto Queue template to properly set all configuration properties

[ https://issues.apache.org/jira/browse/YARN-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359366#comment-17359366 ] Qi Zhu edited comment on YARN-10801 at 6/8/21, 1:42 PM: Thanks [~

[jira] [Commented] (YARN-10801) Fix Auto Queue template to properly set all configuration properties

[ https://issues.apache.org/jira/browse/YARN-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17360017#comment-17360017 ] Qi Zhu commented on YARN-10801: --- Thanks [~gandras] for update. The latest patch LGTM. > F

[jira] [Assigned] (YARN-10657) We should make max application per queue to support node label.

[ https://issues.apache.org/jira/browse/YARN-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reassigned YARN-10657: - Assignee: (was: Qi Zhu) > We should make max application per queue to support node label. >

<    5   6   7   8   9   10   11   >