[jira] [Comment Edited] (YARN-10610) Add queuePath to restful api for CapacityScheduler consistent with FairScheduler queuePath.

2021-02-05 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279538#comment-17279538 ] Qi Zhu edited comment on YARN-10610 at 2/5/21, 12:50 PM: - Thanks [~gandras] for

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-02-05 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279673#comment-17279673 ] Qi Zhu commented on YARN-10178: --- The test failed is not related. These tests are all passed locally. cc

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

2021-02-08 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281490#comment-17281490 ] Qi Zhu commented on YARN-9615: -- [~jhung] [~bibinchundatt] Is it going on? I think it is helpful for large

[jira] [Assigned] (YARN-9615) Add dispatcher metrics to RM

2021-02-10 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reassigned YARN-9615: Assignee: Qi Zhu (was: Jonathan Hung) > Add dispatcher metrics to RM > > >

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

2021-02-10 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282458#comment-17282458 ] Qi Zhu commented on YARN-9615: -- [~jhung] [~bibinchundatt] I want to take it, now attached a patch for

[jira] [Updated] (YARN-9615) Add dispatcher metrics to RM

2021-02-10 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9615: - Attachment: YARN-9615.001.patch > Add dispatcher metrics to RM > > >

[jira] [Updated] (YARN-9615) Add dispatcher metrics to RM

2021-02-10 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9615: - Attachment: YARN-9618.001.patch > Add dispatcher metrics to RM > > >

[jira] [Updated] (YARN-9615) Add dispatcher metrics to RM

2021-02-10 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9615: - Attachment: (was: YARN-9618.001.patch) > Add dispatcher metrics to RM > > >

[jira] [Commented] (YARN-10622) Fix preemption policy to exclude childless ParentQueues

2021-02-10 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282473#comment-17282473 ] Qi Zhu commented on YARN-10622: --- Thanks [~gandras] for good finding.   > Fix preemption policy to exclude

[jira] [Commented] (YARN-10546) Limit application resource reservation on nodes for non-node/rack specific requests shoud be supported in CS.

2021-02-10 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282467#comment-17282467 ] Qi Zhu commented on YARN-10546: --- cc [~wangda] [~ztang] [~epayne]  [~Jim_Brennan] [~ebadger] Could you take

[jira] [Commented] (YARN-10610) Add queuePath to RESTful API for CapacityScheduler consistent with FairScheduler queuePath

2021-02-11 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283017#comment-17283017 ] Qi Zhu commented on YARN-10610: --- !image-2021-02-11-20-58-37-436.png|width=496,height=255! I have checked

[jira] [Updated] (YARN-10610) Add queuePath to RESTful API for CapacityScheduler consistent with FairScheduler queuePath

2021-02-11 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10610: -- Attachment: image-2021-02-11-20-58-37-436.png > Add queuePath to RESTful API for CapacityScheduler consistent

[jira] [Created] (YARN-10623) Capacity scheduler should support refresh queue automatically.

2021-02-10 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10623: - Summary: Capacity scheduler should support refresh queue automatically. Key: YARN-10623 URL: https://issues.apache.org/jira/browse/YARN-10623 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

2021-02-10 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10623: -- Summary: Capacity scheduler should support refresh queue automatically by a thread policy. (was: Capacity

[jira] [Updated] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

2021-02-10 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10623: -- Description: In fair scheduler, it is supported that refresh queue related conf automatically by a thread to

[jira] [Comment Edited] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-11 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280899#comment-17280899 ] Qi Zhu edited comment on YARN-10532 at 2/11/21, 3:13 PM: - [~gandras] I have

[jira] [Created] (YARN-10624) Support max leaf queues limit configuration, consistent with old auto created.

2021-02-11 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10624: - Summary: Support max leaf queues limit configuration, consistent with old auto created. Key: YARN-10624 URL: https://issues.apache.org/jira/browse/YARN-10624 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-23 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307529#comment-17307529 ] Qi Zhu edited comment on YARN-10503 at 3/24/21, 3:35 AM: - Thanks [~ebadger] for

[jira] [Commented] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

2021-03-23 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307540#comment-17307540 ] Qi Zhu commented on YARN-10704: --- Thanks [~ebadger] for review. The UI v2 has not effective absolute

[jira] [Comment Edited] (YARN-10704) The CS effective capacity for absolute mode in UI should support GPU and other custom resources.

2021-03-23 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307540#comment-17307540 ] Qi Zhu edited comment on YARN-10704 at 3/24/21, 3:54 AM: - Thanks [~ebadger] for

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-23 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Attachment: YARN-10503.004.patch > Support queue capacity in terms of absolute resources with custom >

[jira] [Commented] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

2021-03-23 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307509#comment-17307509 ] Qi Zhu commented on YARN-10517: --- Thanks [~ebadger] for review. [~pbacsko] [~epayne] Could you help review

[jira] [Commented] (YARN-10707) Support gpu in ResourceUtilization, and update Node GPU Utilization to use.

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307654#comment-17307654 ] Qi Zhu commented on YARN-10707: --- Thanks [~ebadger] for review. I will updated a patch for custom resource

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-23 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307529#comment-17307529 ] Qi Zhu commented on YARN-10503: --- Thanks [~ebadger] for review. [~pbacsko] Your suggestion is valid, it

[jira] [Updated] (YARN-9936) Support vector of capacity percentages in Capacity Scheduler configuration

2021-03-22 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9936: - Description: Currently, the Capacity Scheduler queue configuration supports two ways to set queue capacity. *

[jira] [Updated] (YARN-9936) Support vector of capacity percentages in Capacity Scheduler configuration

2021-03-22 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9936: - Description: Currently, the Capacity Scheduler queue configuration supports two ways to set queue capacity. *

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-22 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Summary: Support queue capacity in terms of absolute resources with custom resourceType. (was: Support queue

[jira] [Comment Edited] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307772#comment-17307772 ] Qi Zhu edited comment on YARN-10503 at 3/24/21, 12:06 PM: -- Thanks [~gandras] for

[jira] [Updated] (YARN-10637) We should support fs to cs support for auto refresh queues when conf changed, after YARN-10623 finished.

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10637: -- Attachment: YARN-10637.004.patch > We should support fs to cs support for auto refresh queues when conf

[jira] [Commented] (YARN-9618) NodeListManager event improvement

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307674#comment-17307674 ] Qi Zhu commented on YARN-9618: -- Thanks [~ebadger]  [~gandras] for review and clarify. It make sense to me, i

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307772#comment-17307772 ] Qi Zhu commented on YARN-10503: --- Thanks [~gandras] for review. I agree with you. After this jira, if we

[jira] [Comment Edited] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307772#comment-17307772 ] Qi Zhu edited comment on YARN-10503 at 3/24/21, 12:08 PM: -- Thanks [~gandras] for

[jira] [Comment Edited] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307529#comment-17307529 ] Qi Zhu edited comment on YARN-10503 at 3/24/21, 9:04 AM: - Thanks [~ebadger] for

[jira] [Updated] (YARN-9618) NodeListManager event improvement

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-9618: - Attachment: YARN-9618.006.patch > NodeListManager event improvement > - > >

[jira] [Comment Edited] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307509#comment-17307509 ] Qi Zhu edited comment on YARN-10517 at 3/24/21, 9:13 AM: - Thanks [~ebadger] for

[jira] [Commented] (YARN-9618) NodeListManager event improvement

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307688#comment-17307688 ] Qi Zhu commented on YARN-9618: -- [~gandras] [~ebadger] [~pbacsko] I have updated in the patch as [~gandras]

[jira] [Commented] (YARN-10637) We should support fs to cs support for auto refresh queues when conf changed, after YARN-10623 finished.

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307681#comment-17307681 ] Qi Zhu commented on YARN-10637: --- [~gandras] [~pbacsko] Since YARN-10674 has finished. I have updated a

[jira] [Created] (YARN-10713) ClusterMetrics should support custom resource capacity related metrics.

2021-03-24 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10713: - Summary: ClusterMetrics should support custom resource capacity related metrics. Key: YARN-10713 URL: https://issues.apache.org/jira/browse/YARN-10713 Project: Hadoop YARN

[jira] [Commented] (YARN-9618) NodeListManager event improvement

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307845#comment-17307845 ] Qi Zhu commented on YARN-9618: -- The test failed not related this.  > NodeListManager event improvement >

[jira] [Created] (YARN-10711) Make CSQueueMetrics configured related field to support nodelabel.

2021-03-23 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10711: - Summary: Make CSQueueMetrics configured related field to support nodelabel. Key: YARN-10711 URL: https://issues.apache.org/jira/browse/YARN-10711 Project: Hadoop YARN

[jira] [Commented] (YARN-10713) ClusterMetrics should support custom resource capacity related metrics.

2021-03-24 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307966#comment-17307966 ] Qi Zhu commented on YARN-10713: --- [~pbacsko]   [~ebadger]  [~gandras]   [~Jim_Brennan] I have changed to 

[jira] [Commented] (YARN-10674) fs2cs: should support auto created queue deletion.

2021-03-23 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307061#comment-17307061 ] Qi Zhu commented on YARN-10674: --- Thanks [~gandras] for update and discuss with [~pbacsko]. It make sense

[jira] [Updated] (YARN-10674) fs2cs: should support auto created queue deletion.

2021-03-23 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10674: -- Attachment: YARN-10674.017.patch > fs2cs: should support auto created queue deletion. >

[jira] [Assigned] (YARN-10171) Add support for increment-allocation of custom resource types

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu reassigned YARN-10171: - Assignee: Qi Zhu > Add support for increment-allocation of custom resource types >

[jira] [Commented] (YARN-10171) Add support for increment-allocation of custom resource types

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309516#comment-17309516 ] Qi Zhu commented on YARN-10171: --- Since no one help realize it for a long time, I will take it and finished

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308472#comment-17308472 ] Qi Zhu commented on YARN-10503: --- Fixed checksyle in latest patch.  > Support queue capacity in terms of

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Attachment: YARN-10503.006.patch > Support queue capacity in terms of absolute resources with custom >

[jira] [Updated] (YARN-10657) We should make max application per queue to support node label.

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10657: -- Description:

[jira] [Commented] (YARN-10711) Make CSQueueMetrics configured related field to support nodelabel.

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17308625#comment-17308625 ] Qi Zhu commented on YARN-10711: --- cc [~pbacsko] [~gandras] [~ebadger] [~Jim_Brennan] [~epayne]  Updated a

[jira] [Comment Edited] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309840#comment-17309840 ] Qi Zhu edited comment on YARN-10503 at 3/27/21, 2:10 AM: - Thanks [~ebadger] for

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Attachment: YARN-10503.008.patch > Support queue capacity in terms of absolute resources with custom >

[jira] [Updated] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-27 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10503: -- Attachment: YARN-10503.009.patch > Support queue capacity in terms of absolute resources with custom >

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-27 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309897#comment-17309897 ] Qi Zhu commented on YARN-10503: --- Fixed the mistake in latest patch. > Support queue capacity in terms of

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309840#comment-17309840 ] Qi Zhu commented on YARN-10503: --- Thanks [~ebadger] for good suggestion, i have updated in latest patch.

[jira] [Commented] (YARN-10707) Support custom resources in ResourceUtilization, and update Node GPU Utilization to use.

2021-03-27 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309955#comment-17309955 ] Qi Zhu commented on YARN-10707: --- Fixed checkstyle and test error in latest patch. > Support custom

[jira] [Updated] (YARN-10707) Support custom resources in ResourceUtilization, and update Node GPU Utilization to use.

2021-03-27 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10707: -- Attachment: YARN-10707.005.patch > Support custom resources in ResourceUtilization, and update Node GPU >

[jira] [Created] (YARN-10718) Fix CapacityScheduler#initScheduler log error.

2021-03-27 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10718: - Summary: Fix CapacityScheduler#initScheduler log error. Key: YARN-10718 URL: https://issues.apache.org/jira/browse/YARN-10718 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-10718) Fix CapacityScheduler#initScheduler log error.

2021-03-27 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309983#comment-17309983 ] Qi Zhu commented on YARN-10718: ---  [~pbacsko] [~gandras]  [~ebadger]  Fixed an obvious log error in this

[jira] [Commented] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309084#comment-17309084 ] Qi Zhu commented on YARN-10517: --- Thanks [~epayne] for reply. Actually i not see it in the UI, i just see

[jira] [Comment Edited] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309084#comment-17309084 ] Qi Zhu edited comment on YARN-10517 at 3/26/21, 2:12 AM: - Thanks [~epayne] for

[jira] [Comment Edited] (YARN-10517) QueueMetrics has incorrect Allocated Resource when labelled partitions updated

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309084#comment-17309084 ] Qi Zhu edited comment on YARN-10517 at 3/26/21, 2:33 AM: - Thanks [~epayne] for

[jira] [Commented] (YARN-10519) Refactor QueueMetricsForCustomResources class to move to yarn-common package

2021-03-25 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309130#comment-17309130 ] Qi Zhu commented on YARN-10519: --- [~minni31] [~bibinchundatt] Could you help back-port to branch-3-2?

[jira] [Commented] (YARN-10657) We should make max application per queue to support node label.

2021-03-26 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309193#comment-17309193 ] Qi Zhu commented on YARN-10657: --- cc [~pbacsko]  [~epayne] [~gandras] [~bteke]   Updated a patch for

[jira] [Commented] (YARN-10707) Support custom resources in ResourceUtilization, and update Node GPU Utilization to use.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17310209#comment-17310209 ] Qi Zhu commented on YARN-10707: --- The test is not related. > Support custom resources in

[jira] [Updated] (YARN-10693) Add document for YARN-10623 auto refresh queue conf in cs.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10693: -- Attachment: (was: YARN-10693.001.patch) > Add document for YARN-10623 auto refresh queue conf in cs. >

[jira] [Updated] (YARN-10693) Add document for YARN-10623 auto refresh queue conf in cs.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10693: -- Attachment: YARN-10693.001.patch > Add document for YARN-10623 auto refresh queue conf in cs. >

[jira] [Commented] (YARN-10693) Add document for YARN-10623 auto refresh queue conf in cs.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311275#comment-17311275 ] Qi Zhu commented on YARN-10693: --- cc  [~pbacsko]  [~gandras]  [~bteke] Updated a patch for review. Thanks.

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent proxy server hang.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Summary: YARN WebAppProxyServlet should support connection timeout to prevent proxy server hang. (was: YARN

[jira] [Created] (YARN-10723) Change CS nodes page in UI to support custom resource.

2021-03-30 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10723: - Summary: Change CS nodes page in UI to support custom resource. Key: YARN-10723 URL: https://issues.apache.org/jira/browse/YARN-10723 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-10702) Add cluster metric for amount of CPU used by RM Event Processor

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311321#comment-17311321 ] Qi Zhu commented on YARN-10702: --- Thanks [~Jim_Brennan] for update. The update LGTM, and i agree this

[jira] [Comment Edited] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17310481#comment-17310481 ] Qi Zhu edited comment on YARN-10720 at 3/30/21, 5:41 AM: - cc  [~pbacsko] 

[jira] [Comment Edited] (YARN-10718) Fix CapacityScheduler#initScheduler log error.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309983#comment-17309983 ] Qi Zhu edited comment on YARN-10718 at 3/30/21, 5:42 AM: -  [~pbacsko] [~gandras]  

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent proxy server hung.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Summary: YARN WebAppProxyServlet should support connection timeout to prevent proxy server hung. (was: YARN

[jira] [Commented] (YARN-10693) Add document for YARN-10623 auto refresh queue conf in cs.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311340#comment-17311340 ] Qi Zhu commented on YARN-10693: --- Fixed the white space in latest patch. > Add document for YARN-10623 auto

[jira] [Updated] (YARN-10693) Add document for YARN-10623 auto refresh queue conf in cs.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10693: -- Attachment: YARN-10693.002.patch > Add document for YARN-10623 auto refresh queue conf in cs. >

[jira] [Updated] (YARN-10693) Add document for YARN-10623 auto refresh queue conf in cs.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10693: -- Attachment: YARN-10693.003.patch > Add document for YARN-10623 auto refresh queue conf in cs. >

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: image-2021-03-29-13-42-47-672.png > YARN WebAppProxyServlet should support connection timeout to

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Commented] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17310481#comment-17310481 ] Qi Zhu commented on YARN-10720: --- cc  [~pbacsko] [~ebadger] [~Jim_Brennan]  [~ztang]  [~epayne] [~gandras]  

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: YARN-10720.002.patch > YARN WebAppProxyServlet should support connection timeout to prevent too

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Priority: Critical (was: Major) > YARN WebAppProxyServlet should support connection timeout to prevent too

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: (was: image-2021-03-29-13-44-05-579.png) > YARN WebAppProxyServlet should support connection

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: image-2021-03-29-14-05-32-708.png > YARN WebAppProxyServlet should support connection timeout to

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: (was: image-2021-03-29-13-42-47-672.png) > YARN WebAppProxyServlet should support connection

[jira] [Created] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
Qi Zhu created YARN-10720: - Summary: YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections. Key: YARN-10720 URL: https://issues.apache.org/jira/browse/YARN-10720

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-28 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: image-2021-03-29-13-44-05-579.png > YARN WebAppProxyServlet should support connection timeout to

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: image-2021-03-29-14-04-33-776.png > YARN WebAppProxyServlet should support connection timeout to

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Description: Following is proxy server show, {color:#de350b}too many connections from one client{color}, this

[jira] [Commented] (YARN-9618) NodeListManager event improvement

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311627#comment-17311627 ] Qi Zhu commented on YARN-9618: -- [~ebadger] The code now is no new stress should be tested, this will helpful

[jira] [Commented] (YARN-10723) Change CS nodes page in UI to support custom resource.

2021-03-30 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17311624#comment-17311624 ] Qi Zhu commented on YARN-10723: ---  cc  [~pbacsko] [~ebadger]  [~gandras]   Updated a patch for review.

[jira] [Updated] (YARN-10720) YARN WebAppProxyServlet should support connection timeout to prevent too many abnormal connections.

2021-03-29 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10720: -- Attachment: YARN-10720.003.patch > YARN WebAppProxyServlet should support connection timeout to prevent too

[jira] [Updated] (YARN-10723) Change CS nodes page in UI to support custom resource.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qi Zhu updated YARN-10723: -- Attachment: YARN-10723.003.patch > Change CS nodes page in UI to support custom resource. >

[jira] [Commented] (YARN-10503) Support queue capacity in terms of absolute resources with custom resourceType.

2021-03-31 Thread Qi Zhu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17312219#comment-17312219 ] Qi Zhu commented on YARN-10503: --- [~pbacsko] [~gandras] [~ebadger]  If you any other advice? :D Thanks. >

<    1   2   3   4   5   6   7   8   9   10   >