[jira] [Updated] (YARN-10608) Extend yarn.nodemanager.delete.debug-delay-sec to support application level.

[ https://issues.apache.org/jira/browse/YARN-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10608: -- Description: Now the yarn.nodemanager.delete.debug-delay-sec is a cluster level setting. In our busy

[jira] [Commented] (YARN-10589) Improve logic of multi-node allocation

[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17276992#comment-17276992 ] Qi Zhu commented on YARN-10589: --- [~ztang] [~tanu.ajmera] I attached a new patch 003  based 002 , i think

[jira] [Created] (YARN-10608) Extend yarn.nodemanager.delete.debug-delay-sec to support application level.

Qi Zhu created YARN-10608: - Summary: Extend yarn.nodemanager.delete.debug-delay-sec to support application level. Key: YARN-10608 URL: https://issues.apache.org/jira/browse/YARN-10608 Project: Hadoop YARN

[jira] [Commented] (YARN-10589) Improve logic of multi-node allocation

[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277031#comment-17277031 ] Qi Zhu commented on YARN-10589: --- [~tanu.ajmera] I agree with [~ztang] that we need to split the code to

[jira] [Updated] (YARN-10589) Improve logic of multi-node allocation

[ https://issues.apache.org/jira/browse/YARN-10589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10589: -- Attachment: YARN-10589-003.patch > Improve logic of multi-node allocation >

[jira] [Commented] (YARN-10611) Fix that shaded should be used for google guava imports in YARN-10352.

[ https://issues.apache.org/jira/browse/YARN-10611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278478#comment-17278478 ] Qi Zhu commented on YARN-10611: --- Thanks for [~ahussein] reply. The finding bugs will be fixed in 

[jira] [Comment Edited] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278079#comment-17278079 ] Qi Zhu edited comment on YARN-10610 at 2/4/21, 3:40 AM:  [~snemeth]  [~shuzirra] 

[jira] [Comment Edited] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274163#comment-17274163 ] Qi Zhu edited comment on YARN-10178 at 2/4/21, 3:27 AM: [~wangda] [~bteke] I

[jira] [Created] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

Qi Zhu created YARN-10609: - Summary: Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue) Key: YARN-10609 URL: https://issues.apache.org/jira/browse/YARN-10609

[jira] [Commented] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277137#comment-17277137 ] Qi Zhu commented on YARN-10609: --- cc [~wangda] [~snemeth] [~gandras] [~pbacsko] If you can review and merge

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10532: -- Attachment: YARN-10532.010.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue

[jira] [Comment Edited] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277137#comment-17277137 ] Qi Zhu edited comment on YARN-10609 at 2/2/21, 2:19 PM: cc [~wangda] [~snemeth] 

[jira] [Commented] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277704#comment-17277704 ] Qi Zhu commented on YARN-10610: --- 1. In our product cluster, we want to migrate fs to cs, but the cs restful

[jira] [Comment Edited] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277704#comment-17277704 ] Qi Zhu edited comment on YARN-10610 at 2/3/21, 5:53 AM: 1. In our product

[jira] [Created] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

Qi Zhu created YARN-10610: - Summary: Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath. Key: YARN-10610 URL: https://issues.apache.org/jira/browse/YARN-10610 Project:

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10532: -- Attachment: YARN-10532.011.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277660#comment-17277660 ] Qi Zhu commented on YARN-10532: --- Thanks for [~gandras] patient review. I have fixed the above.  But the

[jira] [Comment Edited] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277704#comment-17277704 ] Qi Zhu edited comment on YARN-10610 at 2/3/21, 5:54 AM: 1. In our product

[jira] [Updated] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10610: -- Description: The cs only have queueName, but not full queuePath.

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10532: -- Attachment: YARN-10532.012.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277789#comment-17277789 ] Qi Zhu commented on YARN-10532: --- Fixed the java doc, finding bugs, and check style in latest patch. >

[jira] [Updated] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10610: -- Issue Type: Improvement (was: Bug) > Add queuePath to restful api for CapacityScheduler consistent with >

[jira] [Comment Edited] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277704#comment-17277704 ] Qi Zhu edited comment on YARN-10610 at 2/3/21, 9:27 AM: 1. In our product

[jira] [Comment Edited] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277704#comment-17277704 ] Qi Zhu edited comment on YARN-10610 at 2/3/21, 9:29 AM: 1. In our product

[jira] [Commented] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277977#comment-17277977 ] Qi Zhu commented on YARN-10610: --- Thanks a lot for [~shuzirra] review. Fix the 

[jira] [Updated] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10610: -- Attachment: YARN-10610.002.patch > Add queuePath to restful api for CapacityScheduler consistent with >

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10532: -- Attachment: YARN-10532.013.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue

[jira] [Updated] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10532: -- Attachment: YARN-10532.014.patch > Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue

[jira] [Commented] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278079#comment-17278079 ] Qi Zhu commented on YARN-10610: ---  [~snemeth]  [~shuzirra] The finding bug is not related to this change,

[jira] [Commented] (YARN-10611) Fix that shaded should be used for google guava imports in YARN-10352.

[ https://issues.apache.org/jira/browse/YARN-10611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278132#comment-17278132 ] Qi Zhu commented on YARN-10611: --- cc [~ahussein] Fixed the guava import in 

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278121#comment-17278121 ] Qi Zhu commented on YARN-10352: --- Thanks for [~ahussein] review. I will help to fix this  > Skip schedule

[jira] [Created] (YARN-10611) Fix that shaded should be used for google guava imports in YARN-10352.

Qi Zhu created YARN-10611: - Summary: Fix that shaded should be used for google guava imports in YARN-10352. Key: YARN-10611 URL: https://issues.apache.org/jira/browse/YARN-10611 Project: Hadoop YARN

[jira] [Updated] (YARN-10611) Fix that shaded should be used for google guava imports in YARN-10352.

[ https://issues.apache.org/jira/browse/YARN-10611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10611: -- Description: Fix that shaded should be used for google guava imports in YARN-10352. (was: Fix ) > Fix that

[jira] [Updated] (YARN-10611) Fix that shaded should be used for google guava imports in YARN-10352.

[ https://issues.apache.org/jira/browse/YARN-10611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10611: -- Description: Fix  > Fix that shaded should be used for google guava imports in YARN-10352. >

[jira] [Commented] (YARN-10352) Skip schedule on not heartbeated nodes in Multi Node Placement

[ https://issues.apache.org/jira/browse/YARN-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278134#comment-17278134 ] Qi Zhu commented on YARN-10352: --- [~ahussein] Fixed it in YARN-10611. Thanks. > Skip schedule on not

[jira] [Commented] (YARN-10807) Parents node labels are incorrectly added to child queues in weight mode

[ https://issues.apache.org/jira/browse/YARN-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17358980#comment-17358980 ] Qi Zhu commented on YARN-10807: --- Thanks [~bteke] for update. The patch LGTM.   > Parents node labels are

[jira] [Commented] (YARN-10801) Fix Auto Queue template to properly set all configuration properties

[ https://issues.apache.org/jira/browse/YARN-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17360017#comment-17360017 ] Qi Zhu commented on YARN-10801: --- Thanks [~gandras] for update. The latest patch LGTM. > Fix Auto Queue

[jira] [Commented] (YARN-10657) We should make max application per queue to support node label.

[ https://issues.apache.org/jira/browse/YARN-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17360109#comment-17360109 ] Qi Zhu commented on YARN-10657: --- [~gandras] Of course you can take it, and i will help review. :D Assigned

[jira] [Assigned] (YARN-10657) We should make max application per queue to support node label.

[ https://issues.apache.org/jira/browse/YARN-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reassigned YARN-10657: - Assignee: Andras Gyori > We should make max application per queue to support node label. >

[jira] [Assigned] (YARN-10657) We should make max application per queue to support node label.

[ https://issues.apache.org/jira/browse/YARN-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reassigned YARN-10657: - Assignee: (was: Qi Zhu) > We should make max application per queue to support node label. >

[jira] [Commented] (YARN-10807) Parents node labels are incorrectly added to child queues in weight mode

[ https://issues.apache.org/jira/browse/YARN-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359343#comment-17359343 ] Qi Zhu commented on YARN-10807: --- Thanks [~bteke] for patch and [~gandras] for review. Committed to trunk.

[jira] [Comment Edited] (YARN-10801) Fix Auto Queue template to properly set all configuration properties

[ https://issues.apache.org/jira/browse/YARN-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359366#comment-17359366 ] Qi Zhu edited comment on YARN-10801 at 6/8/21, 1:42 PM: Thanks [~gandras] for

[jira] [Commented] (YARN-10801) Fix Auto Queue template to properly set all configuration properties

[ https://issues.apache.org/jira/browse/YARN-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17359366#comment-17359366 ] Qi Zhu commented on YARN-10801: --- Thanks [~gandras] for patch LGTM now. I have a question about the code,

[jira] [Updated] (YARN-10632) Make maximum depth allowed configurable.

[ https://issues.apache.org/jira/browse/YARN-10632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10632: -- Attachment: YARN-10632.004.patch > Make maximum depth allowed configurable. >

[jira] [Commented] (YARN-10632) Make maximum depth allowed configurable.

[ https://issues.apache.org/jira/browse/YARN-10632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343950#comment-17343950 ] Qi Zhu commented on YARN-10632: --- Fixed the checkstyle and java doc in latest patch. > Make maximum depth

[jira] [Commented] (YARN-10759) Encapsulate queue config modes

[ https://issues.apache.org/jira/browse/YARN-10759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17342269#comment-17342269 ] Qi Zhu commented on YARN-10759: --- Thanks [~gandras] for this work. Very good work, i am very appreciate you

[jira] [Commented] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343084#comment-17343084 ] Qi Zhu commented on YARN-10517: --- Thanks [~zhanqi.cai] for confirm. cc [~pbacsko]  [~ebadger] [~epayne] >

[jira] [Commented] (YARN-10764) Add rm dispatcher event metrics in SLS

[ https://issues.apache.org/jira/browse/YARN-10764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344490#comment-17344490 ] Qi Zhu commented on YARN-10764: --- I think we should add the event related metrics to SLS, such as : # The

[jira] [Commented] (YARN-10737) Fix typos in CapacityScheduler#schedule.

[ https://issues.apache.org/jira/browse/YARN-10737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344319#comment-17344319 ] Qi Zhu commented on YARN-10737: --- Thanks [~hexiaoqiao]  [@fdalsotto|https://github.com/fdalsotto] for

[jira] [Commented] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344372#comment-17344372 ] Qi Zhu commented on YARN-10761: --- Thanks [~ebadger] [~gandras]  [~chaosju] for review. Merged to trunk.  

[jira] [Assigned] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reassigned YARN-10324: - Assignee: Yao Guangdong > Fetch data from NodeManager may case read timeout when disk is busy >

[jira] [Commented] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344478#comment-17344478 ] Qi Zhu commented on YARN-10324: --- Hi [~yaoguangdong]  Thanks for this work. I have added you to the

[jira] [Commented] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344483#comment-17344483 ] Qi Zhu commented on YARN-10761: --- Thanks [~snemeth] for reminder. Sorry for the commit. The YARN-9615 is

[jira] [Comment Edited] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344483#comment-17344483 ] Qi Zhu edited comment on YARN-10761 at 5/14/21, 9:26 AM: - Thanks [~snemeth] for

[jira] [Commented] (YARN-10766) [UI2] Bump moment-timezone to 0.5.33

[ https://issues.apache.org/jira/browse/YARN-10766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344462#comment-17344462 ] Qi Zhu commented on YARN-10766: --- Thanks [~gandras] for patch. LGTM +1 > [UI2] Bump moment-timezone to

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344531#comment-17344531 ] Qi Zhu commented on YARN-9615: -- [~chaosju] Sure.:D > Add dispatcher metrics to RM >

[jira] [Commented] (YARN-10763) add the speed of containers assigned metrics to ClusterMetrics

[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17345849#comment-17345849 ] Qi Zhu commented on YARN-10763: --- Thanks [~chaosju] for update. The latest patch LGTM +1.   > add the

[jira] [Commented] (YARN-10555) missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17345995#comment-17345995 ] Qi Zhu commented on YARN-10555: --- It was merged by [~aajisaka] , i just make it fixed. Thanks

[jira] [Commented] (YARN-8564) Add queue level application lifetime monitor in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346911#comment-17346911 ] Qi Zhu commented on YARN-8564: -- Thanks [~tarunparimi] for reminder. I reopened it, you can take it if you

[jira] [Commented] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347005#comment-17347005 ] Qi Zhu commented on YARN-10771: --- Thanks [~chaosju] for update. The patch LGTM, go on to fix the

[jira] [Reopened] (YARN-8564) Add queue level application lifetime monitor in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reopened YARN-8564: -- > Add queue level application lifetime monitor in FairScheduler >

[jira] [Comment Edited] (YARN-10774) Federation: Normalize the yarn federation queue name

[ https://issues.apache.org/jira/browse/YARN-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347427#comment-17347427 ] Qi Zhu edited comment on YARN-10774 at 5/19/21, 9:01 AM: - [~luoyuan] Now fs

[jira] [Commented] (YARN-10701) The yarn.resource-types should support multi types without trimmed.

[ https://issues.apache.org/jira/browse/YARN-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347438#comment-17347438 ] Qi Zhu commented on YARN-10701: --- Thanks [~weichiu] for reminder. I will help to backport to branch-3.3. >

[jira] [Commented] (YARN-10774) Federation: Normalize the yarn federation queue name

[ https://issues.apache.org/jira/browse/YARN-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347427#comment-17347427 ] Qi Zhu commented on YARN-10774: --- [~luoyuan] Now fs support both root.XXX and xxx but cs still not support

[jira] [Reopened] (YARN-10701) The yarn.resource-types should support multi types without trimmed.

[ https://issues.apache.org/jira/browse/YARN-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reopened YARN-10701: --- > The yarn.resource-types should support multi types without trimmed. >

[jira] [Commented] (YARN-10701) The yarn.resource-types should support multi types without trimmed.

[ https://issues.apache.org/jira/browse/YARN-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347445#comment-17347445 ] Qi Zhu commented on YARN-10701: --- Submitted backport-3.3 patch to trigger jenkins. > The

[jira] [Commented] (YARN-10738) When multi thread scheduling with multi node, we should shuffle with a gap to prevent hot accessing nodes.

[ https://issues.apache.org/jira/browse/YARN-10738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17340599#comment-17340599 ] Qi Zhu commented on YARN-10738: --- Thanks a lot [~bibinchundatt] for reply and value information. For above

[jira] [Updated] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10761: -- Attachment: YARN-10761.002.patch > Add more event type to RM Dispatcher event metrics. >

[jira] [Commented] (YARN-10755) Multithreaded loading Apps from zk statestore

[ https://issues.apache.org/jira/browse/YARN-10755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17340570#comment-17340570 ] Qi Zhu commented on YARN-10755: --- Thanks [~chaosju] report , and [~BilwaST] for taking this. I will help

[jira] [Updated] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10761: -- Attachment: YARN-10761.003.patch > Add more event type to RM Dispatcher event metrics. >

[jira] [Commented] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17340582#comment-17340582 ] Qi Zhu commented on YARN-10761: --- Fixed checkstyle in latest patch. > Add more event type to RM Dispatcher

[jira] [Commented] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17340529#comment-17340529 ] Qi Zhu commented on YARN-10761: --- Thanks a lot [~ebadger] for review. I have changed the two create to one,

[jira] [Commented] (YARN-10763) add the speed of containers assigned metrics to ClusterMetrics

[ https://issues.apache.org/jira/browse/YARN-10763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17340883#comment-17340883 ] Qi Zhu commented on YARN-10763: --- Thanks [~chaosju] for report. If you can use aggregateContainersAllocated

[jira] [Comment Edited] (YARN-9927) RM multi-thread event processing mechanism

[ https://issues.apache.org/jira/browse/YARN-9927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17339383#comment-17339383 ] Qi Zhu edited comment on YARN-9927 at 5/6/21, 6:41 AM: --- Great review and

[jira] [Updated] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10761: -- Attachment: image-2021-05-06-16-39-28-362.png > Add more event type to RM Dispatcher event metrics. >

[jira] [Commented] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17340081#comment-17340081 ] Qi Zhu commented on YARN-10761: --- [~ebadger] [~pbacsko] [~gandras] [~bilwa_st] Could you help review this?

[jira] [Updated] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10761: -- Attachment: image-2021-05-06-16-38-51-406.png > Add more event type to RM Dispatcher event metrics. >

[jira] [Created] (YARN-10761) Add more event type to RM Dispatcher event metrics.

Qi Zhu created YARN-10761: - Summary: Add more event type to RM Dispatcher event metrics. Key: YARN-10761 URL: https://issues.apache.org/jira/browse/YARN-10761 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346181#comment-17346181 ] Qi Zhu commented on YARN-10771: --- Thanks [~chaosju] for this. This is useful for user to know the event

[jira] [Commented] (YARN-10555) Missing access check before getAppAttempts

[ https://issues.apache.org/jira/browse/YARN-10555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346018#comment-17346018 ] Qi Zhu commented on YARN-10555: --- Thanks [~aajisaka] for backport. > Missing access check before

[jira] [Commented] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346575#comment-17346575 ] Qi Zhu commented on YARN-10771: --- Thanks [~chaosju] for patch. I think we should change:"rm event queue

[jira] [Comment Edited] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346575#comment-17346575 ] Qi Zhu edited comment on YARN-10771 at 5/18/21, 3:59 AM: - Thanks [~chaosju] for

[jira] [Commented] (YARN-10632) Make maximum depth allowed configurable.

[ https://issues.apache.org/jira/browse/YARN-10632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343750#comment-17343750 ] Qi Zhu commented on YARN-10632: --- Thanks [~gandras] for reminder. I will change it based YARN-10571. >

[jira] [Commented] (YARN-10632) Make maximum depth allowed configurable.

[ https://issues.apache.org/jira/browse/YARN-10632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343782#comment-17343782 ] Qi Zhu commented on YARN-10632: --- [~gandras]  I have updated it in latest patch. > Make maximum depth

[jira] [Updated] (YARN-10632) Make maximum depth allowed configurable.

[ https://issues.apache.org/jira/browse/YARN-10632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10632: -- Attachment: YARN-10632.003.patch > Make maximum depth allowed configurable. >

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349052#comment-17349052 ] Qi Zhu commented on YARN-10779: --- Thanks [~gandras] for reminder. If we should enable use to reinitialize

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348941#comment-17348941 ] Qi Zhu commented on YARN-10779: --- Thanks [~pbacsko] for this work. The patch LGTM, just to fix the only one

[jira] [Commented] (YARN-10657) We should make max application per queue to support node label.

[ https://issues.apache.org/jira/browse/YARN-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349094#comment-17349094 ] Qi Zhu commented on YARN-10657: --- Thanks [~gandras] for reply. We now can close before we can discuss a

[jira] [Commented] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349111#comment-17349111 ] Qi Zhu commented on YARN-10324: --- [~yaoguangdong] You should submitted it, make it patch available, then the

[jira] [Commented] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349124#comment-17349124 ] Qi Zhu commented on YARN-10324: --- [~yaoguangdong] I'm not sure if you removed the original 003, and

[jira] [Commented] (YARN-10781) The Thread of the NM aggregate log is exhausted and no other Application can aggregate the log

[ https://issues.apache.org/jira/browse/YARN-10781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349065#comment-17349065 ] Qi Zhu commented on YARN-10781: --- Thanks [~zhangxiping] for this. If you mean when the Spark dynamic

[jira] [Commented] (YARN-10779) Add option to disable lowercase conversion in GetApplicationsRequestPBImpl and ApplicationSubmissionContextPBImpl

[ https://issues.apache.org/jira/browse/YARN-10779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17349073#comment-17349073 ] Qi Zhu commented on YARN-10779: --- Thanks [~pbacsko] for reply. I also agree that it only affect the

[jira] [Updated] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10324: -- Attachment: image-2021-05-21-17-48-03-476.png > Fetch data from NodeManager may case read timeout when disk is

[jira] [Commented] (YARN-10543) Timeline Server V1.5 not supporting audit log

[ https://issues.apache.org/jira/browse/YARN-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17348066#comment-17348066 ] Qi Zhu commented on YARN-10543: --- Thanks [~gb.ana...@gmail.com] for patch. The patch generally LGTM. But

[jira] [Comment Edited] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347313#comment-17347313 ] Qi Zhu edited comment on YARN-10771 at 5/20/21, 2:29 AM: - Thanks [~chaosju] for

[jira] [Commented] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347313#comment-17347313 ] Qi Zhu commented on YARN-10771: --- Thanks [~chaosju] for update. The patch LGTM now. Waiting [~pbacsko] for

[jira] [Resolved] (YARN-10545) Improve the readability of diagnostics log in yarn-ui2 web page.

[ https://issues.apache.org/jira/browse/YARN-10545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu resolved YARN-10545. --- Fix Version/s: 3.4.0 Resolution: Fixed > Improve the readability of diagnostics log in yarn-ui2 web

[jira] [Assigned] (YARN-10545) Improve the readability of diagnostics log in yarn-ui2 web page.

[ https://issues.apache.org/jira/browse/YARN-10545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reassigned YARN-10545: - Assignee: akiyamaneko > Improve the readability of diagnostics log in yarn-ui2 web page. >

[jira] [Comment Edited] (YARN-10324) Fetch data from NodeManager may case read timeout when disk is busy

[ https://issues.apache.org/jira/browse/YARN-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344478#comment-17344478 ] Qi Zhu edited comment on YARN-10324 at 5/14/21, 9:01 AM: - Hi [~yaoguangdong] 

[jira] [Comment Edited] (YARN-10761) Add more event type to RM Dispatcher event metrics.

[ https://issues.apache.org/jira/browse/YARN-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17344483#comment-17344483 ] Qi Zhu edited comment on YARN-10761 at 5/14/21, 9:16 AM: - Thanks [~snemeth] for

  1   2   3   4   5   6   7   8   9   10   >