[jira] [Updated] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9413: --- Attachment: image-2019-03-29-10-47-47-953.png > Queue resource leak after app fail for CapacityScheduler >

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803905#comment-16803905 ] Tao Yang commented on YARN-9413: Attached v2 patch to fix compile error and update name of new test case

[jira] [Updated] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9413: --- Attachment: YARN-9413.002.patch > Queue resource leak after app fail for CapacityScheduler >

[jira] [Updated] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9423: --- Description: We have met a slow recovery for applications after many NM lost: # many NM shut down at the

[jira] [Updated] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9423: --- Description: We have met a slow recovery for applications after many NM lost: # many NM shut down at the

[jira] [Created] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

Tao Yang created YARN-9423: -- Summary: Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time Key: YARN-9423 URL: https://issues.apache.org/jira/browse/YARN-9423

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803659#comment-16803659 ] Tao Yang commented on YARN-9413: {quote}  Can you submit the patch to trigger jenkins job? {quote}

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802434#comment-16802434 ] Tao Yang commented on YARN-9413: I think we can keep consistency of handling app attempt failure through

[jira] [Updated] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9413: --- Attachment: YARN-9413.001.patch > Queue resource leak after app fail for CapacityScheduler >

[jira] [Created] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

Tao Yang created YARN-9413: -- Summary: Queue resource leak after app fail for CapacityScheduler Key: YARN-9413 URL: https://issues.apache.org/jira/browse/YARN-9413 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Description: We have did some usability improvements for scheduler activities based on YARN3.1 in our

[jira] [Updated] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Description: We have did some usability improvements for scheduler activities based on YARN3.1 in our

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779021#comment-16779021 ] Tao Yang commented on YARN-9313: Attached v2 patch, key changes are as follows: (1) Update host of

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.002.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Commented] (YARN-9300) Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776517#comment-16776517 ] Tao Yang commented on YARN-9300: Thanks [~cheersyang] for the review and commit! > Lazy preemption should

[jira] [Comment Edited] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773929#comment-16773929 ] Tao Yang edited comment on YARN-9195 at 2/21/19 10:26 AM: -- Thanks [~ssy] for

[jira] [Comment Edited] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773929#comment-16773929 ] Tao Yang edited comment on YARN-9195 at 2/21/19 10:25 AM: -- Thanks [~ssy] for

[jira] [Commented] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773929#comment-16773929 ] Tao Yang commented on YARN-9195: Thanks [~ssy] for solving this problem. I have just reviewed this patch,

[jira] [Comment Edited] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772781#comment-16772781 ] Tao Yang edited comment on YARN-9313 at 2/20/19 9:38 AM: - Descriptions of key

[jira] [Comment Edited] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772781#comment-16772781 ] Tao Yang edited comment on YARN-9313 at 2/20/19 9:35 AM: - Descriptions of key

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: (was: YARN-9313.001.patch) > Support asynchronized scheduling mode and multi-node lookup

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772781#comment-16772781 ] Tao Yang commented on YARN-9313: Descriptions of key changes in this patch are as follows, hope someone

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: (was: YARN-9313.001.patch) > Support asynchronized scheduling mode and multi-node lookup

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: (was: YARN-9313.001.patch) > Support asynchronized scheduling mode and multi-node lookup

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Updated] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Summary: [Umbrella] Usability improvements for scheduler activities (was: Usability improvements for

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771815#comment-16771815 ] Tao Yang commented on YARN-9313: Hi, [~cheersyang], [~leftnoteasy]. I have attached v1 patch, could you

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Created] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

Tao Yang created YARN-9313: -- Summary: Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities Key: YARN-9313 URL: https://issues.apache.org/jira/browse/YARN-9313

[jira] [Updated] (YARN-9300) Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9300: --- Attachment: YARN-9300.001.patch > Lazy preemption should trigger an update on queue preemption metrics for >

[jira] [Created] (YARN-9300) Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler

Tao Yang created YARN-9300: -- Summary: Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler Key: YARN-9300 URL: https://issues.apache.org/jira/browse/YARN-9300 Project:

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743796#comment-16743796 ] Tao Yang commented on YARN-9050: Hi, [~cheersyang]. As a footnote, this change will only record one

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743735#comment-16743735 ] Tao Yang commented on YARN-9050: Thanks [~cheersyang] for the review. {quote} Will this add a lot of

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16738219#comment-16738219 ] Tao Yang commented on YARN-9050: Hi [~leftnoteasy], [~cheersyang]  Design doc is attached

[jira] [Commented] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732634#comment-16732634 ] Tao Yang commented on YARN-9163: Hi [~ziqian hu] We have communicated about this problem offline before,

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726451#comment-16726451 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for the review and commit. Attached a patch for

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925-branch-3.2.001.patch > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725825#comment-16725825 ] Tao Yang commented on YARN-8925: Hi, [~cheersyang]. Perhaps there is no

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16716634#comment-16716634 ] Tao Yang commented on YARN-8925: Hi, [~cheersyang] Just noticed DISTRIBUTED and CENTRALIZED attributes can

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.010.patch > Updating distributed node attributes only when necessary >

[jira] [Updated] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Description: We have did some usability improvements for scheduler activities based on YARN3.1 in our

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707010#comment-16707010 ] Tao Yang commented on YARN-9050: Thanks [~leftnoteasy] for your support. I would like to work on this

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701600#comment-16701600 ] Tao Yang commented on YARN-9050: cc: [~cheersyang], [~leftnoteasy], [~sunil.g]. I would be interested in

[jira] [Updated] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Component/s: capacityscheduler > Usability improvements for scheduler activities >

[jira] [Updated] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Description: We have did some usability improvements for scheduler activities based on YARN3.1 in our

[jira] [Created] (YARN-9050) Usability improvements for scheduler activities

Tao Yang created YARN-9050: -- Summary: Usability improvements for scheduler activities Key: YARN-9050 URL: https://issues.apache.org/jira/browse/YARN-9050 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-9043) Inter-queue preemption sometimes starves an underserved queue when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9043: --- Attachment: YARN-9043.001.patch > Inter-queue preemption sometimes starves an underserved queue when using >

[jira] [Updated] (YARN-9043) Inter-queue preemption sometimes starves an underserved queue when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9043: --- Description: To reproduce this problem in UT, we can setup a cluster with resource <40,18> and create 3

[jira] [Created] (YARN-9043) Inter-queue preemption sometimes starves an underserved queue when using DominantResourceCalculator

Tao Yang created YARN-9043: -- Summary: Inter-queue preemption sometimes starves an underserved queue when using DominantResourceCalculator Key: YARN-9043 URL: https://issues.apache.org/jira/browse/YARN-9043

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694173#comment-16694173 ] Tao Yang commented on YARN-9007: Thanks [~wilfreds] for the comments. I agree that current preemptions

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692807#comment-16692807 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang]. Attached v9 patch to change the log level of

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.009.patch > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692794#comment-16692794 ] Tao Yang commented on YARN-8925: Hi, [~cheersyang] Can we change the log level of updating node

[jira] [Comment Edited] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692794#comment-16692794 ] Tao Yang edited comment on YARN-8925 at 11/20/18 7:45 AM: -- Hi, [~cheersyang] Can

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.008.patch > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692750#comment-16692750 ] Tao Yang commented on YARN-8925: Replaced v8 patch to apply for latest trunk. > Updating distributed node

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: (was: YARN-8925.008.patch) > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692726#comment-16692726 ] Tao Yang commented on YARN-8925: Attached v8 patch to improve the log contents. > Updating distributed

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.008.patch > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692724#comment-16692724 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for the review. {quote} 1. Both RM/NM side logs

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16691219#comment-16691219 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for the testing. I think the node attributes are

[jira] [Comment Edited] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689162#comment-16689162 ] Tao Yang edited comment on YARN-8925 at 11/16/18 8:31 AM: -- Hi, [~cheersyang]

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689162#comment-16689162 ] Tao Yang commented on YARN-8925: Hi, [~cheersyang] Thanks for your mention! Yes, there is a mistake in v6

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.007.patch > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689143#comment-16689143 ] Tao Yang commented on YARN-8958: Hi，[~cheersyang] I think the race condition may happen when app is moving

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687430#comment-16687430 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for your suggestion. Attached v6 patch to fix

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.006.patch > Updating distributed node attributes only when necessary >

[jira] [Comment Edited] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682851#comment-16682851 ] Tao Yang edited comment on YARN-9007 at 11/11/18 11:53 AM: --- Add "for queue and

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682851#comment-16682851 ] Tao Yang commented on YARN-9007: Add "for queue and reserved container preemption" to the end of this

[jira] [Updated] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9007: --- Summary: CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved

[jira] [Updated] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue/reserved

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9007: --- Summary: CS preemption monitor should only select GUARANTEED containers as candidates for queue/reserved

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682846#comment-16682846 ] Tao Yang commented on YARN-9007: Thanks [~sunilg] for your attention. IIUC,

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682402#comment-16682402 ] Tao Yang commented on YARN-9007: Attached v1 patch. [~leftnoteasy], [~sunilg], could you help to review

[jira] [Updated] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9007: --- Attachment: YARN-9007.001.patch > CS preemption monitor should only select GUARANTEED containers as

[jira] [Created] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

Tao Yang created YARN-9007: -- Summary: CS preemption monitor should only select GUARANTEED containers as candidates Key: YARN-9007 URL: https://issues.apache.org/jira/browse/YARN-9007 Project: Hadoop YARN

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682339#comment-16682339 ] Tao Yang commented on YARN-7461: Hi, [~sunilg], [~leftnoteasy], [~templedf], [~cheersyang]. Can we keep

[jira] [Commented] (YARN-9006) TestNodeLabelContainerAllocation fails in branch-3.0

[ https://issues.apache.org/jira/browse/YARN-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682327#comment-16682327 ] Tao Yang commented on YARN-9006: These failures are caused by the inconsistent default value of

[jira] [Commented] (YARN-8245) Validate the existence of parent queue for add-queue operation in scheduler-conf REST API

[ https://issues.apache.org/jira/browse/YARN-8245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682281#comment-16682281 ] Tao Yang commented on YARN-8245: Hi, [~jhung], could you help to review this patch? Thanks. > Validate

[jira] [Commented] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682277#comment-16682277 ] Tao Yang commented on YARN-8505: There is no jenkins report for v2 patch. Attached again to trigger it.

[jira] [Updated] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8505: --- Attachment: YARN-8505.003.patch > AMLimit and userAMLimit check should be skipped for unmanaged AM >

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682272#comment-16682272 ] Tao Yang commented on YARN-8925: Attached v5 patch to fix some checkstyle warnings and trigger QA check.

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.005.patch > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681186#comment-16681186 ] Tao Yang commented on YARN-8233: (y)(y), thanks [~ajisakaa] for your help to solve this problem. > NPE in

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681183#comment-16681183 ] Tao Yang commented on YARN-8995: Hi, [~zhuqi] +1 for this improvement. We have encountered bottleneck of

[jira] [Comment Edited] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680649#comment-16680649 ] Tao Yang edited comment on YARN-8233 at 11/9/18 12:24 AM: -- Thanks [~ajisakaa] for

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680649#comment-16680649 ] Tao Yang commented on YARN-8233: Thanks [~ajisakaa] for your effort to figure out this failure. Is this

[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680632#comment-16680632 ] Tao Yang commented on YARN-8988: Thanks [~cheersyang] for the review and commit. > Reduce the verbose log

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679416#comment-16679416 ] Tao Yang commented on YARN-8925: Attached v4 patch for review. [~cheersyang], pls help to review at your

[jira] [Comment Edited] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679371#comment-16679371 ] Tao Yang edited comment on YARN-8925 at 11/8/18 7:16 AM: - Thanks [~cheersyang] for

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679371#comment-16679371 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for the review and comments.

[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679438#comment-16679438 ] Tao Yang commented on YARN-8988: Attached v1 patch with updating log level to DEBUG. > Reduce the verbose

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.004.patch > Updating distributed node attributes only when necessary >

[jira] [Updated] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8988: --- Attachment: YARN-8988.001.patch > Reduce the verbose log on RM heartbeat path when distributed

[jira] [Comment Edited] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679371#comment-16679371 ] Tao Yang edited comment on YARN-8925 at 11/8/18 7:23 AM: - Thanks [~cheersyang] for

[jira] [Comment Edited] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678045#comment-16678045 ] Tao Yang edited comment on YARN-8233 at 11/7/18 11:06 AM: -- Hi, [~ajisakaa],

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678045#comment-16678045 ] Tao Yang commented on YARN-8233: Hi, [~ajisakaa], [~cheersyang] I have attached 3 patches: (1) patch for

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8233: --- Attachment: YARN-8233.001.branch-3.1.patch YARN-8233.001.branch-3.0.patch

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677689#comment-16677689 ] Tao Yang commented on YARN-8233: Thanks [~ajisakaa], [~cheersyang] for the review and commit ! I will

<    1   2   3   4   5   6   7   8   9   10   >