[jira] [Updated] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9413: --- Attachment: image-2019-03-29-10-47-47-953.png > Queue resource leak after app fail for CapacityScheduler > ---

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16803905#comment-16803905 ] Tao Yang commented on YARN-9413: Attached v2 patch to fix compile error and update name of

[jira] [Updated] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9413: --- Attachment: YARN-9413.002.patch > Queue resource leak after app fail for CapacityScheduler > -

[jira] [Updated] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9423: --- Description: We have met a slow recovery for applications after many NM lost: # many NM shut down at the same

[jira] [Updated] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9423: --- Description: We have met a slow recovery for applications after many NM lost: # many NM shut down at the same

[jira] [Created] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

Tao Yang created YARN-9423: -- Summary: Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time Key: YARN-9423 URL: https://issues.apache.org/jira/browse/YARN-9423 P

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16803659#comment-16803659 ] Tao Yang commented on YARN-9413: {quote}  Can you submit the patch to trigger jenkins job

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16802434#comment-16802434 ] Tao Yang commented on YARN-9413: I think we can keep consistency of handling app attempt f

[jira] [Updated] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9413: --- Attachment: YARN-9413.001.patch > Queue resource leak after app fail for CapacityScheduler > -

[jira] [Created] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

Tao Yang created YARN-9413: -- Summary: Queue resource leak after app fail for CapacityScheduler Key: YARN-9413 URL: https://issues.apache.org/jira/browse/YARN-9413 Project: Hadoop YARN Issue Type: Bu

[jira] [Updated] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Description: We have did some usability improvements for scheduler activities based on YARN3.1 in our cluster

[jira] [Updated] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Description: We have did some usability improvements for scheduler activities based on YARN3.1 in our cluster

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16779021#comment-16779021 ] Tao Yang commented on YARN-9313: Attached v2 patch, key changes are as follows: (1) Updat

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.002.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for >

[jira] [Commented] (YARN-9300) Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16776517#comment-16776517 ] Tao Yang commented on YARN-9300: Thanks [~cheersyang] for the review and commit! > Lazy p

[jira] [Comment Edited] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773929#comment-16773929 ] Tao Yang edited comment on YARN-9195 at 2/21/19 10:26 AM: -- Thanks

[jira] [Comment Edited] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773929#comment-16773929 ] Tao Yang edited comment on YARN-9195 at 2/21/19 10:25 AM: -- Thanks

[jira] [Commented] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16773929#comment-16773929 ] Tao Yang commented on YARN-9195: Thanks [~ssy] for solving this problem. I have just revi

[jira] [Comment Edited] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772781#comment-16772781 ] Tao Yang edited comment on YARN-9313 at 2/20/19 9:38 AM: - Descript

[jira] [Comment Edited] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772781#comment-16772781 ] Tao Yang edited comment on YARN-9313 at 2/20/19 9:35 AM: - Descript

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for >

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: (was: YARN-9313.001.patch) > Support asynchronized scheduling mode and multi-node lookup mecha

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16772781#comment-16772781 ] Tao Yang commented on YARN-9313: Descriptions of key changes in this patch are as follows,

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: (was: YARN-9313.001.patch) > Support asynchronized scheduling mode and multi-node lookup mecha

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for >

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: (was: YARN-9313.001.patch) > Support asynchronized scheduling mode and multi-node lookup mecha

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for >

[jira] [Updated] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Summary: [Umbrella] Usability improvements for scheduler activities (was: Usability improvements for schedule

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16771815#comment-16771815 ] Tao Yang commented on YARN-9313: Hi, [~cheersyang], [~leftnoteasy]. I have attached v1 pa

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for >

[jira] [Created] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

Tao Yang created YARN-9313: -- Summary: Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities Key: YARN-9313 URL: https://issues.apache.org/jira/browse/YARN-9313 Projec

[jira] [Updated] (YARN-9300) Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-9300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9300: --- Attachment: YARN-9300.001.patch > Lazy preemption should trigger an update on queue preemption metrics for >

[jira] [Created] (YARN-9300) Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler

Tao Yang created YARN-9300: -- Summary: Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler Key: YARN-9300 URL: https://issues.apache.org/jira/browse/YARN-9300 Project: H

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743796#comment-16743796 ] Tao Yang commented on YARN-9050: Hi, [~cheersyang]. As a footnote, this change will only r

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16743735#comment-16743735 ] Tao Yang commented on YARN-9050: Thanks [~cheersyang] for the review. {quote} Will this ad

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16738219#comment-16738219 ] Tao Yang commented on YARN-9050: Hi [~leftnoteasy], [~cheersyang]  Design doc is attached

[jira] [Commented] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16732634#comment-16732634 ] Tao Yang commented on YARN-9163: Hi [~ziqian hu] We have communicated about this problem o

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16726451#comment-16726451 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for the review and commit. Attached

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925-branch-3.2.001.patch > Updating distributed node attributes only when necessary > --

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16725825#comment-16725825 ] Tao Yang commented on YARN-8925: Hi, [~cheersyang]. Perhaps there is no {{yarn.nodemanage

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16716634#comment-16716634 ] Tao Yang commented on YARN-8925: Hi, [~cheersyang] Just noticed DISTRIBUTED and CENTRALIZE

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.010.patch > Updating distributed node attributes only when necessary > -

[jira] [Updated] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Description: We have did some usability improvements for scheduler activities based on YARN3.1 in our cluster

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16707010#comment-16707010 ] Tao Yang commented on YARN-9050: Thanks [~leftnoteasy] for your support. I would like to w

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16701600#comment-16701600 ] Tao Yang commented on YARN-9050: cc: [~cheersyang], [~leftnoteasy], [~sunil.g]. I would b

[jira] [Updated] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Component/s: capacityscheduler > Usability improvements for scheduler activities > ---

[jira] [Updated] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Description: We have did some usability improvements for scheduler activities based on YARN3.1 in our cluster

[jira] [Created] (YARN-9050) Usability improvements for scheduler activities

Tao Yang created YARN-9050: -- Summary: Usability improvements for scheduler activities Key: YARN-9050 URL: https://issues.apache.org/jira/browse/YARN-9050 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-9043) Inter-queue preemption sometimes starves an underserved queue when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9043: --- Attachment: YARN-9043.001.patch > Inter-queue preemption sometimes starves an underserved queue when using >

[jira] [Updated] (YARN-9043) Inter-queue preemption sometimes starves an underserved queue when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9043: --- Description: To reproduce this problem in UT, we can setup a cluster with resource <40,18> and create 3 queue

[jira] [Created] (YARN-9043) Inter-queue preemption sometimes starves an underserved queue when using DominantResourceCalculator

Tao Yang created YARN-9043: -- Summary: Inter-queue preemption sometimes starves an underserved queue when using DominantResourceCalculator Key: YARN-9043 URL: https://issues.apache.org/jira/browse/YARN-9043 P

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16694173#comment-16694173 ] Tao Yang commented on YARN-9007: Thanks [~wilfreds] for the comments. I agree that curren

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16692807#comment-16692807 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang]. Attached v9 patch to change the lo

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.009.patch > Updating distributed node attributes only when necessary > -

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16692794#comment-16692794 ] Tao Yang commented on YARN-8925: Hi, [~cheersyang] Can we change the log level of updatin

[jira] [Comment Edited] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16692794#comment-16692794 ] Tao Yang edited comment on YARN-8925 at 11/20/18 7:45 AM: -- Hi, [~

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.008.patch > Updating distributed node attributes only when necessary > -

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16692750#comment-16692750 ] Tao Yang commented on YARN-8925: Replaced v8 patch to apply for latest trunk. > Updating

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: (was: YARN-8925.008.patch) > Updating distributed node attributes only when necessary > --

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16692726#comment-16692726 ] Tao Yang commented on YARN-8925: Attached v8 patch to improve the log contents. > Updatin

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.008.patch > Updating distributed node attributes only when necessary > -

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16692724#comment-16692724 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for the review. {quote} 1. Both RM/N

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16691219#comment-16691219 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for the testing. I think the node at

[jira] [Comment Edited] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16689162#comment-16689162 ] Tao Yang edited comment on YARN-8925 at 11/16/18 8:31 AM: -- Hi, [~

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16689162#comment-16689162 ] Tao Yang commented on YARN-8925: Hi, [~cheersyang] Thanks for your mention! Yes, there is

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.007.patch > Updating distributed node attributes only when necessary > -

[jira] [Commented] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16689143#comment-16689143 ] Tao Yang commented on YARN-8958: Hi，[~cheersyang] I think the race condition may happen wh

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16687430#comment-16687430 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for your suggestion. Attached v6 pat

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.006.patch > Updating distributed node attributes only when necessary > -

[jira] [Comment Edited] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682851#comment-16682851 ] Tao Yang edited comment on YARN-9007 at 11/11/18 11:53 AM: --- Add

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682851#comment-16682851 ] Tao Yang commented on YARN-9007: Add "for queue and reserved container preemption" to the

[jira] [Updated] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9007: --- Summary: CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved c

[jira] [Updated] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue/reserved

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9007: --- Summary: CS preemption monitor should only select GUARANTEED containers as candidates for queue/reserved (was

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682846#comment-16682846 ] Tao Yang commented on YARN-9007: Thanks [~sunilg] for your attention. IIUC, intra-queue/in

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682402#comment-16682402 ] Tao Yang commented on YARN-9007: Attached v1 patch. [~leftnoteasy], [~sunilg], could you

[jira] [Updated] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9007: --- Attachment: YARN-9007.001.patch > CS preemption monitor should only select GUARANTEED containers as candidates

[jira] [Created] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

Tao Yang created YARN-9007: -- Summary: CS preemption monitor should only select GUARANTEED containers as candidates Key: YARN-9007 URL: https://issues.apache.org/jira/browse/YARN-9007 Project: Hadoop YARN

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682339#comment-16682339 ] Tao Yang commented on YARN-7461: Hi, [~sunilg], [~leftnoteasy], [~templedf], [~cheersyang]

[jira] [Commented] (YARN-9006) TestNodeLabelContainerAllocation fails in branch-3.0

[ https://issues.apache.org/jira/browse/YARN-9006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682327#comment-16682327 ] Tao Yang commented on YARN-9006: These failures are caused by the inconsistent default val

[jira] [Commented] (YARN-8245) Validate the existence of parent queue for add-queue operation in scheduler-conf REST API

[ https://issues.apache.org/jira/browse/YARN-8245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682281#comment-16682281 ] Tao Yang commented on YARN-8245: Hi, [~jhung], could you help to review this patch? Thanks

[jira] [Commented] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682277#comment-16682277 ] Tao Yang commented on YARN-8505: There is no jenkins report for v2 patch. Attached again

[jira] [Updated] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8505: --- Attachment: YARN-8505.003.patch > AMLimit and userAMLimit check should be skipped for unmanaged AM > -

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16682272#comment-16682272 ] Tao Yang commented on YARN-8925: Attached v5 patch to fix some checkstyle warnings and tri

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.005.patch > Updating distributed node attributes only when necessary > -

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16681186#comment-16681186 ] Tao Yang commented on YARN-8233: (y)(y), thanks [~ajisakaa] for your help to solve this pr

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16681183#comment-16681183 ] Tao Yang commented on YARN-8995: Hi, [~zhuqi] +1 for this improvement. We have encountere

[jira] [Comment Edited] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680649#comment-16680649 ] Tao Yang edited comment on YARN-8233 at 11/9/18 12:24 AM: -- Thanks

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680649#comment-16680649 ] Tao Yang commented on YARN-8233: Thanks [~ajisakaa] for your effort to figure out this fai

[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16680632#comment-16680632 ] Tao Yang commented on YARN-8988: Thanks [~cheersyang] for the review and commit. > Reduce

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679416#comment-16679416 ] Tao Yang commented on YARN-8925: Attached v4 patch for review. [~cheersyang], pls help to

[jira] [Comment Edited] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679371#comment-16679371 ] Tao Yang edited comment on YARN-8925 at 11/8/18 7:16 AM: - Thanks [

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679371#comment-16679371 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for the review and comments. {quote}

[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679438#comment-16679438 ] Tao Yang commented on YARN-8988: Attached v1 patch with updating log level to DEBUG. > Re

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.004.patch > Updating distributed node attributes only when necessary > -

[jira] [Updated] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8988: --- Attachment: YARN-8988.001.patch > Reduce the verbose log on RM heartbeat path when distributed node-attributes

[jira] [Comment Edited] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679371#comment-16679371 ] Tao Yang edited comment on YARN-8925 at 11/8/18 7:23 AM: - Thanks [

[jira] [Comment Edited] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678045#comment-16678045 ] Tao Yang edited comment on YARN-8233 at 11/7/18 11:06 AM: -- Hi, [~

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678045#comment-16678045 ] Tao Yang commented on YARN-8233: Hi, [~ajisakaa], [~cheersyang] I have attached 3 patches:

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8233: --- Attachment: YARN-8233.001.branch-3.1.patch YARN-8233.001.branch-3.0.patch YARN-

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677689#comment-16677689 ] Tao Yang commented on YARN-8233: Thanks [~ajisakaa], [~cheersyang] for the review and comm

<    1   2   3   4   5   6   7   8   9   10   >