[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620333#comment-16620333 ] Tao Yang commented on YARN-8771: Attached v4 patch to fix check-style error. UT failures seem unrelated

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620042#comment-16620042 ] Tao Yang commented on YARN-8771: Attached v3 patch to improve unit test without adding new

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620001#comment-16620001 ] Tao Yang commented on YARN-8771: Thanks [~leftnoteasy] for your review and suggestion. I will update the

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Attachment: YARN-8771.003.patch > CapacityScheduler fails to unreserve when cluster resource contains empty

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Description: We found this problem when cluster is almost but not exhausted (93% used), scheduler kept

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Description: We found this problem when cluster is almost but not exhausted (93% used), scheduler kept

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Description: We found this problem when cluster is almost but not exhausted (93% used), scheduler kept

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619181#comment-16619181 ] Tao Yang commented on YARN-8771: Thanks [~cheersyang] for the review. {quote} Instead of adding a new

[jira] [Updated] (YARN-9432) Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled

2019-04-02 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9432: --- Attachment: YARN-9432.002.patch > Excess reserved containers may exist for a long time after its request has

[jira] [Commented] (YARN-9432) Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled

2019-04-02 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807475#comment-16807475 ] Tao Yang commented on YARN-9432: Attached v2 patch to fix check-style error and UT failures. > Excess

[jira] [Updated] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9439: --- Attachment: YARN-9439.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Created] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-04 Thread Tao Yang (JIRA)
Tao Yang created YARN-9440: -- Summary: Improve diagnostics for scheduler and app activities Key: YARN-9440 URL: https://issues.apache.org/jira/browse/YARN-9440 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-04 Thread Tao Yang (JIRA)
Tao Yang created YARN-9439: -- Summary: Support asynchronized scheduling mode and multi-node lookup mechanism for app activities Key: YARN-9439 URL: https://issues.apache.org/jira/browse/YARN-9439 Project:

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Description: [Design

[jira] [Updated] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9439: --- Description: [Design

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.003.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809881#comment-16809881 ] Tao Yang commented on YARN-9313: There are some basic modifications on trunk recently (for example: log4j

[jira] [Comment Edited] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809881#comment-16809881 ] Tao Yang edited comment on YARN-9313 at 4/4/19 2:04 PM: There are some basic

[jira] [Updated] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9439: --- Attachment: YARN-9439.002.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810428#comment-16810428 ] Tao Yang commented on YARN-9439: This patch is dependent on YARN-9313, I think the patch should wait (not

[jira] [Updated] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

2019-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9423: --- Description: We have met a slow recovery for applications after many NM lost: # many NM shut down at the

[jira] [Updated] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

2019-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9423: --- Description: We have met a slow recovery for applications after many NM lost: # many NM shut down at the

[jira] [Updated] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9413: --- Attachment: YARN-9413.002.patch > Queue resource leak after app fail for CapacityScheduler >

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803659#comment-16803659 ] Tao Yang commented on YARN-9413: {quote}  Can you submit the patch to trigger jenkins job? {quote}

[jira] [Created] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

2019-03-28 Thread Tao Yang (JIRA)
Tao Yang created YARN-9423: -- Summary: Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time Key: YARN-9423 URL: https://issues.apache.org/jira/browse/YARN-9423

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803905#comment-16803905 ] Tao Yang commented on YARN-9413: Attached v2 patch to fix compile error and update name of new test case

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804536#comment-16804536 ] Tao Yang commented on YARN-9413: Thanks [~cheersyang], [~snemeth] for your suggestions.

[jira] [Updated] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9413: --- Attachment: image-2019-03-29-10-47-47-953.png > Queue resource leak after app fail for CapacityScheduler >

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804589#comment-16804589 ] Tao Yang commented on YARN-9413: Thanks [~cheersyang] for the confirmation about the checkstyle error.

[jira] [Updated] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

2019-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9423: --- Attachment: YARN-9423.001.patch > Optimize AM launcher to avoid bottleneck when a large number of AM failover

[jira] [Updated] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9413: --- Attachment: YARN-9413.003.patch > Queue resource leak after app fail for CapacityScheduler >

[jira] [Updated] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

2019-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9423: --- Attachment: YARN-9423.001.patch > Optimize AM launcher to avoid bottleneck when a large number of AM failover

[jira] [Updated] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

2019-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9423: --- Attachment: (was: YARN-9423.001.patch) > Optimize AM launcher to avoid bottleneck when a large number of

[jira] [Commented] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

2019-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804680#comment-16804680 ] Tao Yang commented on YARN-9423: Attached v1 patch for review.  Please feel free to give your suggestions.

[jira] [Updated] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

2019-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9423: --- Description: We have met a slow recovery for applications after many NM lost: # many NM shut down at the

[jira] [Created] (YARN-9432) Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled

2019-04-01 Thread Tao Yang (JIRA)
Tao Yang created YARN-9432: -- Summary: Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled Key: YARN-9432 URL:

[jira] [Updated] (YARN-9432) Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled

2019-04-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9432: --- Attachment: YARN-9432.001.patch > Excess reserved containers may exist for a long time after its request has

[jira] [Updated] (YARN-9432) Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled

2019-04-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9432: --- Attachment: (was: YARN-9432.001.patch) > Excess reserved containers may exist for a long time after its

[jira] [Commented] (YARN-9432) Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled

2019-04-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806676#comment-16806676 ] Tao Yang commented on YARN-9432: Attached v1 patch for review. > Excess reserved containers may exist for

[jira] [Updated] (YARN-9432) Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled

2019-04-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9432: --- Attachment: YARN-9432.001.patch > Excess reserved containers may exist for a long time after its request has

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812110#comment-16812110 ] Tao Yang commented on YARN-9413: The checkstyle issue seems the same as above and UT failures are not

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812056#comment-16812056 ] Tao Yang commented on YARN-9313: Attached v5 patch to fix remaining checkstyle errors, UT and findbugs

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.005.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-08 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812400#comment-16812400 ] Tao Yang commented on YARN-9313: Thanks [~cheersyang] for the review and commit! I have submitted the

[jira] [Created] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-03-26 Thread Tao Yang (JIRA)
Tao Yang created YARN-9413: -- Summary: Queue resource leak after app fail for CapacityScheduler Key: YARN-9413 URL: https://issues.apache.org/jira/browse/YARN-9413 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-03-26 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802434#comment-16802434 ] Tao Yang commented on YARN-9413: I think we can keep consistency of handling app attempt failure through

[jira] [Updated] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-03-26 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9413: --- Attachment: YARN-9413.001.patch > Queue resource leak after app fail for CapacityScheduler >

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-02-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771815#comment-16771815 ] Tao Yang commented on YARN-9313: Hi, [~cheersyang], [~leftnoteasy]. I have attached v1 patch, could you

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-02-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Updated] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

2019-02-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Summary: [Umbrella] Usability improvements for scheduler activities (was: Usability improvements for

[jira] [Created] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-02-19 Thread Tao Yang (JIRA)
Tao Yang created YARN-9313: -- Summary: Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities Key: YARN-9313 URL: https://issues.apache.org/jira/browse/YARN-9313

[jira] [Comment Edited] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

2019-02-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773929#comment-16773929 ] Tao Yang edited comment on YARN-9195 at 2/21/19 10:25 AM: -- Thanks [~ssy] for

[jira] [Commented] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

2019-02-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773929#comment-16773929 ] Tao Yang commented on YARN-9195: Thanks [~ssy] for solving this problem. I have just reviewed this patch,

[jira] [Comment Edited] (YARN-9195) RM Queue's pending container number might get decreased unexpectedly or even become negative once RM failover

2019-02-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16773929#comment-16773929 ] Tao Yang edited comment on YARN-9195 at 2/21/19 10:26 AM: -- Thanks [~ssy] for

[jira] [Updated] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

2019-02-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Description: We have did some usability improvements for scheduler activities based on YARN3.1 in our

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-02-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.002.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-02-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779021#comment-16779021 ] Tao Yang commented on YARN-9313: Attached v2 patch, key changes are as follows: (1) Update host of

[jira] [Updated] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

2019-02-27 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Description: We have did some usability improvements for scheduler activities based on YARN3.1 in our

[jira] [Commented] (YARN-9300) Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler

2019-02-24 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776517#comment-16776517 ] Tao Yang commented on YARN-9300: Thanks [~cheersyang] for the review and commit! > Lazy preemption should

[jira] [Updated] (YARN-9300) Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler

2019-02-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9300: --- Attachment: YARN-9300.001.patch > Lazy preemption should trigger an update on queue preemption metrics for >

[jira] [Created] (YARN-9300) Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler

2019-02-13 Thread Tao Yang (JIRA)
Tao Yang created YARN-9300: -- Summary: Lazy preemption should trigger an update on queue preemption metrics for CapacityScheduler Key: YARN-9300 URL: https://issues.apache.org/jira/browse/YARN-9300 Project:

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-02-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: (was: YARN-9313.001.patch) > Support asynchronized scheduling mode and multi-node lookup

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-02-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-02-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772781#comment-16772781 ] Tao Yang commented on YARN-9313: Descriptions of key changes in this patch are as follows, hope someone

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-02-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: (was: YARN-9313.001.patch) > Support asynchronized scheduling mode and multi-node lookup

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-02-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-02-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: (was: YARN-9313.001.patch) > Support asynchronized scheduling mode and multi-node lookup

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-02-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Comment Edited] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-02-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772781#comment-16772781 ] Tao Yang edited comment on YARN-9313 at 2/20/19 9:35 AM: - Descriptions of key

[jira] [Comment Edited] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-02-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772781#comment-16772781 ] Tao Yang edited comment on YARN-9313 at 2/20/19 9:38 AM: - Descriptions of key

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815014#comment-16815014 ] Tao Yang commented on YARN-9439: Thanks [~cheersyang] for the review. {quote} In ActivityManager, the

[jira] [Updated] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9439: --- Attachment: YARN-9439.004.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815046#comment-16815046 ] Tao Yang commented on YARN-9439: Thanks [~cheersyang] for the confirmation. Attached v4 patch to fix the

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811729#comment-16811729 ] Tao Yang commented on YARN-9413: Thanks [~cheersyang], [~snemeth] for the review and commit. {quote} could

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.004.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811725#comment-16811725 ] Tao Yang commented on YARN-9313: Attached v4 patch. Thanks [~cheersyang] for your advices. > Support

[jira] [Updated] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9413: --- Attachment: YARN-9413.branch-3.0.001.patch > Queue resource leak after app fail for CapacityScheduler >

[jira] [Commented] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811744#comment-16811744 ] Tao Yang commented on YARN-9050: Hi, [~adam.antal]. As far as I know, currently activities is only used by

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-09 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813997#comment-16813997 ] Tao Yang commented on YARN-9439: Hi, [~cheersyang]. Findbugs warnings are not related to this patch. They

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: (was: YARN-9440.001.patch) > Improve diagnostics for scheduler and app activities >

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: YARN-9440.001.patch > Improve diagnostics for scheduler and app activities >

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-09 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: YARN-9440.001.patch > Improve diagnostics for scheduler and app activities >

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814127#comment-16814127 ] Tao Yang commented on YARN-9440: Attached v1 patch for review. Key changes in this patch: * basic **

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-15 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16817820#comment-16817820 ] Tao Yang commented on YARN-9439: Thanks [~cheersyang] for your concern. The latest jenkins result seems

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-15 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818510#comment-16818510 ] Tao Yang commented on YARN-9439: Thanks [~cheersyang] for the review and commit. Next subtask of YARN-9050

[jira] [Created] (YARN-9489) Support filtering by request-priorities and allocation-request-ids for query results of app activities

2019-04-16 Thread Tao Yang (JIRA)
Tao Yang created YARN-9489: -- Summary: Support filtering by request-priorities and allocation-request-ids for query results of app activities Key: YARN-9489 URL: https://issues.apache.org/jira/browse/YARN-9489

[jira] [Comment Edited] (YARN-9472) Add multi-thread asynchronous scheduling to fair scheduler

2019-04-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820685#comment-16820685 ] Tao Yang edited comment on YARN-9472 at 4/18/19 3:36 AM: - Thanks [~zhuqi] for

[jira] [Updated] (YARN-9495) Fix findbugs warnings in hadoop-yarn-server-resourcemanager module

2019-04-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9495: --- Attachment: screenshot-1.png > Fix findbugs warnings in hadoop-yarn-server-resourcemanager module >

[jira] [Commented] (YARN-9495) Fix findbugs warnings in hadoop-yarn-server-resourcemanager module

2019-04-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820647#comment-16820647 ] Tao Yang commented on YARN-9495: Thanks [~adam.antal] for the reply and thanks [~giovanni.fumarola] for

[jira] [Commented] (YARN-9472) Add multi-thread asynchronous scheduling to fair scheduler

2019-04-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820685#comment-16820685 ] Tao Yang commented on YARN-9472: Thanks [~zhuqi] for confirming that. Currently most components of global

[jira] [Updated] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-04-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9497: --- Description: [Design Doc

[jira] [Created] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-04-18 Thread Tao Yang (JIRA)
Tao Yang created YARN-9497: -- Summary: Support grouping by diagnostics for query results of scheduler and app activities Key: YARN-9497 URL: https://issues.apache.org/jira/browse/YARN-9497 Project: Hadoop

[jira] [Updated] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-04-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9497: --- Environment: (was: [Design Doc

[jira] [Commented] (YARN-9490) applicationresourceusagereport return wrong number of reserved containers

2019-04-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820800#comment-16820800 ] Tao Yang commented on YARN-9490: Thanks [~zyb] for updating the patch. +1 for the new patch. BTW, patches

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819674#comment-16819674 ] Tao Yang commented on YARN-9440: Thanks [~cheersyang]. Attached v2 patch to fix UT failures which are

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Description: [Design doc

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: YARN-9440.002.patch > Improve diagnostics for scheduler and app activities >

[jira] [Updated] (YARN-9489) Support filtering by request-priorities and allocation-request-ids for query results of app activities

2019-04-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9489: --- Attachment: YARN-9489.001.patch > Support filtering by request-priorities and allocation-request-ids for

[jira] [Commented] (YARN-9490) applicationresourceusagereport return wrong number of reserved containers

2019-04-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819703#comment-16819703 ] Tao Yang commented on YARN-9490: Thanks [~zyb] for raising this issue. The patch makes sense to me, just a

[jira] [Commented] (YARN-9479) Change String.equals to Objects.equals(String,String) to avoid possible NullPointerException

2019-04-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819822#comment-16819822 ] Tao Yang commented on YARN-9479: Hi, [~bd2019us]. IIUC, the unique entrance to call

<    1   2   3   4   5   6   7   8   9   10   >