[jira] [Created] (YARN-11550) PreemptedResourceSeconds is wrongly recovered when RM has a restart

2023-08-15 Thread Juanjuan Tian (Jira)
Juanjuan Tian created YARN-11550: - Summary: PreemptedResourceSeconds is wrongly recovered when RM has a restart Key: YARN-11550 URL: https://issues.apache.org/jira/browse/YARN-11550 Project: Hadoop

[jira] [Updated] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2023-03-22 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian updated YARN-11108: -- Description: Found unexpected preemptions happen when hierarchy queues case, the issue is

[jira] [Comment Edited] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2023-03-22 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517935#comment-17517935 ] Juanjuan Tian edited comment on YARN-11108 at 3/23/23 5:47 AM: When

[jira] [Comment Edited] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2023-03-22 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517935#comment-17517935 ] Juanjuan Tian edited comment on YARN-11108 at 3/23/23 5:46 AM: When

[jira] [Comment Edited] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2023-03-22 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517935#comment-17517935 ] Juanjuan Tian edited comment on YARN-11108 at 3/23/23 5:42 AM: When

[jira] [Comment Edited] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2022-04-22 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517935#comment-17517935 ] Juanjuan Tian edited comment on YARN-11108 at 4/22/22 9:03 AM: This

[jira] [Comment Edited] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2022-04-10 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517935#comment-17517935 ] Juanjuan Tian edited comment on YARN-11108 at 4/11/22 2:10 AM: This

[jira] [Updated] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2022-04-10 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian updated YARN-11108: -- Description: Found unexpected preemptions happen when hierarchy queues case, the issue is

[jira] [Comment Edited] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2022-04-10 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517935#comment-17517935 ] Juanjuan Tian edited comment on YARN-11108 at 4/11/22 2:09 AM: This

[jira] [Commented] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2022-04-06 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517945#comment-17517945 ] Juanjuan Tian commented on YARN-11108: --- [~wangda]  could you help take a look? > Unexpected

[jira] [Updated] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2022-04-06 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian updated YARN-11108: -- Affects Version/s: 2.9.2 > Unexpected preemptions happen when hierarchy queues case >

[jira] [Assigned] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2022-04-06 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian reassigned YARN-11108: - Assignee: Juanjuan Tian > Unexpected preemptions happen when hierarchy queues case >

[jira] [Comment Edited] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2022-04-06 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517935#comment-17517935 ] Juanjuan Tian edited comment on YARN-11108 at 4/6/22 8:44 AM: --- This issue

[jira] [Comment Edited] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2022-04-06 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517935#comment-17517935 ] Juanjuan Tian edited comment on YARN-11108 at 4/6/22 8:43 AM: --- This issue

[jira] [Commented] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2022-04-06 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517935#comment-17517935 ] Juanjuan Tian commented on YARN-11108: --- This issue is vcaused by below,  when calculating

[jira] [Updated] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2022-04-06 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian updated YARN-11108: -- Attachment: image-2022-04-06-16-29-57-871.png > Unexpected preemptions happen when hierarchy

[jira] [Created] (YARN-11108) Unexpected preemptions happen when hierarchy queues case

2022-04-06 Thread Juanjuan Tian (Jira)
Juanjuan Tian created YARN-11108: - Summary: Unexpected preemptions happen when hierarchy queues case Key: YARN-11108 URL: https://issues.apache.org/jira/browse/YARN-11108 Project: Hadoop YARN

[jira] [Updated] (YARN-9351) user can't use total resources of one partition even when yarn.scheduler.capacity..minimum-user-limit-percent is set to 100

2020-10-14 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian updated YARN-9351: - Summary: user can't use total resources of one partition even when

[jira] [Updated] (YARN-10401) AggregateContainersPreempted in QueueMetrics is not correct when set yarn.scheduler.capacity.lazy-preemption-enabled as true

2020-08-19 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-10401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian updated YARN-10401: -- Attachment: YARN-10401-001.patch > AggregateContainersPreempted in QueueMetrics is not correct

[jira] [Assigned] (YARN-10401) AggregateContainersPreempted in QueueMetrics is not correct when set yarn.scheduler.capacity.lazy-preemption-enabled as true

2020-08-18 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-10401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian reassigned YARN-10401: - Assignee: Juanjuan Tian > AggregateContainersPreempted in QueueMetrics is not correct

[jira] [Created] (YARN-10401) AggregateContainersPreempted in QueueMetrics is not correct when set yarn.scheduler.capacity.lazy-preemption-enabled as true

2020-08-18 Thread Juanjuan Tian (Jira)
Juanjuan Tian created YARN-10401: - Summary: AggregateContainersPreempted in QueueMetrics is not correct when set yarn.scheduler.capacity.lazy-preemption-enabled as true Key: YARN-10401 URL:

[jira] [Commented] (YARN-10384) Add FORBID_SUBMIT_APPLICATIONS acl type to administer queue

2020-08-10 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17175181#comment-17175181 ] Juanjuan Tian commented on YARN-10384: --- [~epayne] Thanks for commets. If an abusive user only

[jira] [Updated] (YARN-9020) AbsoluteCapacity is wrongly set when call ParentQueue#setAbsoluteCapacity

2020-08-04 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian updated YARN-9020: - Summary: AbsoluteCapacity is wrongly set when call ParentQueue#setAbsoluteCapacity (was: set a

[jira] [Updated] (YARN-10384) Add FORBID_SUBMIT_APPLICATIONS acl type to administer queue

2020-08-04 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian updated YARN-10384: -- Fix Version/s: 3.2.0 > Add FORBID_SUBMIT_APPLICATIONS acl type to administer queue >

[jira] [Assigned] (YARN-10384) Add FORBID_SUBMIT_APPLICATIONS acl type to administer queue

2020-08-04 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian reassigned YARN-10384: - Assignee: Juanjuan Tian > Add FORBID_SUBMIT_APPLICATIONS acl type to administer queue

[jira] [Updated] (YARN-10384) Add FORBID_SUBMIT_APPLICATIONS acl type to administer queue

2020-08-04 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian updated YARN-10384: -- Affects Version/s: 3.2.0 > Add FORBID_SUBMIT_APPLICATIONS acl type to administer queue >

[jira] [Updated] (YARN-10384) Add FORBID_SUBMIT_APPLICATIONS acl type to administer queue

2020-08-04 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian updated YARN-10384: -- Description: Currently CapacityScheduler supports acl_submit_applications, 

[jira] [Updated] (YARN-10384) Add FORBID_SUBMIT_APPLICATIONS acl type to administer queue

2020-08-04 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian updated YARN-10384: -- Attachment: YARN-10384-001.patch > Add FORBID_SUBMIT_APPLICATIONS acl type to administer queue

[jira] [Created] (YARN-10384) Add FORBID_SUBMIT_APPLICATIONS acl type to administer queue

2020-08-04 Thread Juanjuan Tian (Jira)
Juanjuan Tian created YARN-10384: - Summary: Add FORBID_SUBMIT_APPLICATIONS acl type to administer queue Key: YARN-10384 URL: https://issues.apache.org/jira/browse/YARN-10384 Project: Hadoop YARN

[jira] [Commented] (YARN-4314) Adding container wait time as a metric at queue level and application level.

2020-04-15 Thread Juanjuan Tian (Jira)
[ https://issues.apache.org/jira/browse/YARN-4314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17084503#comment-17084503 ] Juanjuan Tian commented on YARN-4314: -- any updates about the results? > Adding container wait time

[jira] [Comment Edited] (YARN-9598) Make reservation work well when multi-node enabled

2019-06-10 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859740#comment-16859740 ] Juanjuan Tian edited comment on YARN-9598 at 6/11/19 1:58 AM: --- Hi Tao,

[jira] [Commented] (YARN-9598) Make reservation work well when multi-node enabled

2019-06-10 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859799#comment-16859799 ] Juanjuan Tian commented on YARN-9598: --    "inter-queue preemption can't happened because of resource

[jira] [Commented] (YARN-9598) Make reservation work well when multi-node enabled

2019-06-10 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859776#comment-16859776 ] Juanjuan Tian commented on YARN-9598: -- Hi, [~Tao Yang], just like you said,  there will always be

[jira] [Comment Edited] (YARN-9598) Make reservation work well when multi-node enabled

2019-06-10 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859689#comment-16859689 ] Juanjuan Tian edited comment on YARN-9598 at 6/10/19 6:45 AM: --- Hi Tao,  #

[jira] [Comment Edited] (YARN-9598) Make reservation work well when multi-node enabled

2019-06-10 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859740#comment-16859740 ] Juanjuan Tian edited comment on YARN-9598 at 6/10/19 6:36 AM: --- Hi Tao,

[jira] [Commented] (YARN-9598) Make reservation work well when multi-node enabled

2019-06-10 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859740#comment-16859740 ] Juanjuan Tian commented on YARN-9598: -- Hi Tao, { } disable re-reservation can only make the

[jira] [Comment Edited] (YARN-9598) Make reservation work well when multi-node enabled

2019-06-09 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859689#comment-16859689 ] Juanjuan Tian edited comment on YARN-9598 at 6/10/19 3:47 AM: --- Hi Tao,  #

[jira] [Comment Edited] (YARN-9598) Make reservation work well when multi-node enabled

2019-06-09 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859689#comment-16859689 ] Juanjuan Tian edited comment on YARN-9598 at 6/10/19 3:47 AM: --- Hi Tao,  #

[jira] [Commented] (YARN-9598) Make reservation work well when multi-node enabled

2019-06-09 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16859689#comment-16859689 ] Juanjuan Tian commented on YARN-9598: -- Hi Tao,  # As discussed in YARN-9576, re-reservation

[jira] [Updated] (YARN-9598) Make reservation work well when multi-node enabled

2019-06-09 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian updated YARN-9598: - Attachment: image-2019-06-10-11-37-43-283.png > Make reservation work well when multi-node

[jira] [Updated] (YARN-9598) Make reservation work well when multi-node enabled

2019-06-09 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juanjuan Tian updated YARN-9598: - Attachment: image-2019-06-10-11-37-44-975.png > Make reservation work well when multi-node

[jira] [Comment Edited] (YARN-7494) Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision

2019-05-30 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851660#comment-16851660 ] Juanjuan Tian edited comment on YARN-7494 at 5/30/19 9:02 AM: --- Thanks

[jira] [Comment Edited] (YARN-7494) Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision

2019-05-30 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851660#comment-16851660 ] Juanjuan Tian edited comment on YARN-7494 at 5/30/19 9:00 AM: --- Thanks

[jira] [Comment Edited] (YARN-7494) Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision

2019-05-30 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851660#comment-16851660 ] Juanjuan Tian edited comment on YARN-7494 at 5/30/19 8:59 AM: --- Thanks

[jira] [Commented] (YARN-7494) Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision

2019-05-30 Thread Juanjuan Tian (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851660#comment-16851660 ] Juanjuan Tian commented on YARN-7494: -- Thanks Weiwei for your reply. here seems there is another