[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-05-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Description: Currently on app attempt page we can see outstanding resource requests, it will be helpful for

[jira] [Created] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2019-05-20 Thread Tao Yang (JIRA)
Tao Yang created YARN-9567: -- Summary: Add diagnostics for outstanding resource requests on app attempts page Key: YARN-9567 URL: https://issues.apache.org/jira/browse/YARN-9567 Project: Hadoop YARN

[jira] [Commented] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16842878#comment-16842878 ] Tao Yang commented on YARN-9497: It looks like each dimension or both together are all supported, but each

[jira] [Comment Edited] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841881#comment-16841881 ] Tao Yang edited comment on YARN-9497 at 5/17/19 3:44 AM: - Thanks [~cheersyang] for

[jira] [Commented] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841881#comment-16841881 ] Tao Yang commented on YARN-9497: Thanks [~cheersyang] for the review and suggestions. {quote} we can

[jira] [Comment Edited] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841881#comment-16841881 ] Tao Yang edited comment on YARN-9497 at 5/17/19 3:43 AM: - Thanks [~cheersyang] for

[jira] [Updated] (YARN-9538) Document scheduler/app activities and REST APIs

2019-05-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9538: --- Attachment: YARN-9538.001.patch > Document scheduler/app activities and REST APIs >

[jira] [Commented] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838316#comment-16838316 ] Tao Yang commented on YARN-9497: Thanks [~cheersyang] for the review! Attached v2 patch rebased from

[jira] [Updated] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9497: --- Attachment: YARN-9497.002.patch > Support grouping by diagnostics for query results of scheduler and app >

[jira] [Commented] (YARN-9539) Improve cleanup process of app activities and make some conditions configurable

2019-05-13 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838311#comment-16838311 ] Tao Yang commented on YARN-9539: Thanks [~cheersyang] for the review and commit! > Improve cleanup

[jira] [Updated] (YARN-9539) Improve cleanup process of app activities and make some conditions configurable

2019-05-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9539: --- Attachment: YARN-9539.001.patch > Improve cleanup process of app activities and make some conditions >

[jira] [Updated] (YARN-9539) Improve cleanup process of app activities and make some conditions configurable

2019-05-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9539: --- Description: [YARN-9050 Design doc

[jira] [Updated] (YARN-9539) Improve cleanup process of app activities and make some conditions configurable

2019-05-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9539: --- Environment: (was: [YARN-9050 Design doc

[jira] [Updated] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-05-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9497: --- Attachment: YARN-9497.001.patch > Support grouping by diagnostics for query results of scheduler and app >

[jira] [Commented] (YARN-9489) Support filtering by request-priorities and allocation-request-ids for query results of app activities

2019-05-09 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16836312#comment-16836312 ] Tao Yang commented on YARN-9489: Thanks [~cheersyang] for the review. {quote} {{getAppActivities()}} was

[jira] [Created] (YARN-9539) Improve cleanup process of app activities and make some conditions configurable

2019-05-09 Thread Tao Yang (JIRA)
Tao Yang created YARN-9539: -- Summary: Improve cleanup process of app activities and make some conditions configurable Key: YARN-9539 URL: https://issues.apache.org/jira/browse/YARN-9539 Project: Hadoop YARN

[jira] [Created] (YARN-9538) Document scheduler/app activities and REST APIs

2019-05-09 Thread Tao Yang (JIRA)
Tao Yang created YARN-9538: -- Summary: Document scheduler/app activities and REST APIs Key: YARN-9538 URL: https://issues.apache.org/jira/browse/YARN-9538 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-05-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834538#comment-16834538 ] Tao Yang commented on YARN-9440: Thanks [~cheersyang] for the review and commit! > Improve diagnostics

[jira] [Commented] (YARN-9432) Reserved containers leak after its request has been cancelled or satisfied when multi-nodes enabled

2019-05-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834446#comment-16834446 ] Tao Yang commented on YARN-9432: Thanks [~cheersyang] for the suggestion! Yes, there's a redundant loop 

[jira] [Updated] (YARN-9432) Reserved containers leak after its request has been cancelled or satisfied when multi-nodes enabled

2019-05-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9432: --- Attachment: YARN-9432.004.patch > Reserved containers leak after its request has been cancelled or satisfied

[jira] [Updated] (YARN-9489) Support filtering by request-priorities and allocation-request-ids for query results of app activities

2019-05-06 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9489: --- Attachment: YARN-9489.002.patch > Support filtering by request-priorities and allocation-request-ids for

[jira] [Updated] (YARN-9432) Reserved containers leak after its request has been cancelled or satisfied when multi-nodes enabled

2019-05-06 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9432: --- Attachment: YARN-9432.003.patch > Reserved containers leak after its request has been cancelled or satisfied

[jira] [Commented] (YARN-9432) Reserved containers leak after its request has been cancelled or satisfied when multi-nodes enabled

2019-05-06 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833551#comment-16833551 ] Tao Yang commented on YARN-9432: Thanks [~cheersyang] for the review.  The problem is that

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-05-02 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16831669#comment-16831669 ] Tao Yang commented on YARN-9440: Thanks [~cheersyang] for the review. Remaining check-style warnings are

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: (was: YARN-9440.003.patch) > Improve diagnostics for scheduler and app activities >

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: YARN-9440.003.patch > Improve diagnostics for scheduler and app activities >

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: YARN-9440.003.patch > Improve diagnostics for scheduler and app activities >

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-30 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16830264#comment-16830264 ] Tao Yang commented on YARN-9440: Thanks [~cheersyang] for some advices when we talked on the phone.

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-24 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825704#comment-16825704 ] Tao Yang commented on YARN-9440: Thanks [~cheersyang] for the review.  I think we should discuss the

[jira] [Commented] (YARN-9490) applicationresourceusagereport return wrong number of reserved containers

2019-04-24 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825010#comment-16825010 ] Tao Yang commented on YARN-9490: Thanks [~cheersyang] for the review. The comments make sense to me.

[jira] [Commented] (YARN-9507) NPE when u stop NM if NM Init failed

2019-04-24 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825000#comment-16825000 ] Tao Yang commented on YARN-9507: Thanks [~BilwaST] for fixing this NPE. LGTM, +1 for the patch. > NPE

[jira] [Commented] (YARN-9490) applicationresourceusagereport return wrong number of reserved containers

2019-04-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821949#comment-16821949 ] Tao Yang commented on YARN-9490: Hi, [~cheersyang], could you please help to give contributor permission

[jira] [Reopened] (YARN-9495) Fix findbugs warnings in hadoop-yarn-server-resourcemanager module

2019-04-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang reopened YARN-9495: Hi, [~cheersyang]. I saw the same findbugs warnings again from jenkins report generated today in YARN-9490.

[jira] [Updated] (YARN-9495) Fix findbugs warnings in hadoop-yarn-server-resourcemanager module

2019-04-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9495: --- Attachment: YARN-9495.002.patch > Fix findbugs warnings in hadoop-yarn-server-resourcemanager module >

[jira] [Updated] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-04-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9497: --- Environment: (was: [Design Doc

[jira] [Updated] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-04-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9497: --- Description: [Design Doc

[jira] [Created] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

2019-04-18 Thread Tao Yang (JIRA)
Tao Yang created YARN-9497: -- Summary: Support grouping by diagnostics for query results of scheduler and app activities Key: YARN-9497 URL: https://issues.apache.org/jira/browse/YARN-9497 Project: Hadoop

[jira] [Commented] (YARN-9490) applicationresourceusagereport return wrong number of reserved containers

2019-04-18 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820800#comment-16820800 ] Tao Yang commented on YARN-9490: Thanks [~zyb] for updating the patch. +1 for the new patch. BTW, patches

[jira] [Comment Edited] (YARN-9472) Add multi-thread asynchronous scheduling to fair scheduler

2019-04-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820685#comment-16820685 ] Tao Yang edited comment on YARN-9472 at 4/18/19 3:36 AM: - Thanks [~zhuqi] for

[jira] [Commented] (YARN-9472) Add multi-thread asynchronous scheduling to fair scheduler

2019-04-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820685#comment-16820685 ] Tao Yang commented on YARN-9472: Thanks [~zhuqi] for confirming that. Currently most components of global

[jira] [Commented] (YARN-9495) Fix findbugs warnings in hadoop-yarn-server-resourcemanager module

2019-04-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16820647#comment-16820647 ] Tao Yang commented on YARN-9495: Thanks [~adam.antal] for the reply and thanks [~giovanni.fumarola] for

[jira] [Updated] (YARN-9495) Fix findbugs warnings in hadoop-yarn-server-resourcemanager module

2019-04-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9495: --- Attachment: screenshot-1.png > Fix findbugs warnings in hadoop-yarn-server-resourcemanager module >

[jira] [Updated] (YARN-9495) Fix findbugs warnings in hadoop-yarn-server-resourcemanager module

2019-04-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9495: --- Description: Recently there are 2 extant Findbugs warnings in hadoop-yarn-server-resourcemanager module

[jira] [Updated] (YARN-9495) Fix findbugs warnings in hadoop-yarn-server-resourcemanager module

2019-04-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9495: --- Attachment: YARN-9495.001.patch > Fix findbugs warnings in hadoop-yarn-server-resourcemanager module >

[jira] [Created] (YARN-9495) Fix findbugs warnings in hadoop-yarn-server-resourcemanager module

2019-04-17 Thread Tao Yang (JIRA)
Tao Yang created YARN-9495: -- Summary: Fix findbugs warnings in hadoop-yarn-server-resourcemanager module Key: YARN-9495 URL: https://issues.apache.org/jira/browse/YARN-9495 Project: Hadoop YARN

[jira] [Commented] (YARN-9479) Change String.equals to Objects.equals(String,String) to avoid possible NullPointerException

2019-04-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819822#comment-16819822 ] Tao Yang commented on YARN-9479: Hi, [~bd2019us]. IIUC, the unique entrance to call

[jira] [Commented] (YARN-9490) applicationresourceusagereport return wrong number of reserved containers

2019-04-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819703#comment-16819703 ] Tao Yang commented on YARN-9490: Thanks [~zyb] for raising this issue. The patch makes sense to me, just a

[jira] [Updated] (YARN-9489) Support filtering by request-priorities and allocation-request-ids for query results of app activities

2019-04-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9489: --- Attachment: YARN-9489.001.patch > Support filtering by request-priorities and allocation-request-ids for

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Description: [Design doc

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16819674#comment-16819674 ] Tao Yang commented on YARN-9440: Thanks [~cheersyang]. Attached v2 patch to fix UT failures which are

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: YARN-9440.002.patch > Improve diagnostics for scheduler and app activities >

[jira] [Created] (YARN-9489) Support filtering by request-priorities and allocation-request-ids for query results of app activities

2019-04-16 Thread Tao Yang (JIRA)
Tao Yang created YARN-9489: -- Summary: Support filtering by request-priorities and allocation-request-ids for query results of app activities Key: YARN-9489 URL: https://issues.apache.org/jira/browse/YARN-9489

[jira] [Comment Edited] (YARN-9472) Add multi-thread asynchronous scheduling to fair scheduler

2019-04-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818695#comment-16818695 ] Tao Yang edited comment on YARN-9472 at 4/16/19 9:51 AM: - Hi, [~zhuqi].

[jira] [Commented] (YARN-9472) Add multi-thread asynchronous scheduling to fair scheduler

2019-04-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818695#comment-16818695 ] Tao Yang commented on YARN-9472: Hi, [~zhuqi]. Multi-thread asynchronous scheduling only means support

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-15 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16818510#comment-16818510 ] Tao Yang commented on YARN-9439: Thanks [~cheersyang] for the review and commit. Next subtask of YARN-9050

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-15 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16817820#comment-16817820 ] Tao Yang commented on YARN-9439: Thanks [~cheersyang] for your concern. The latest jenkins result seems

[jira] [Updated] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9439: --- Attachment: YARN-9439.004.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815046#comment-16815046 ] Tao Yang commented on YARN-9439: Thanks [~cheersyang] for the confirmation. Attached v4 patch to fix the

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16815014#comment-16815014 ] Tao Yang commented on YARN-9439: Thanks [~cheersyang] for the review. {quote} In ActivityManager, the

[jira] [Commented] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814127#comment-16814127 ] Tao Yang commented on YARN-9440: Attached v1 patch for review. Key changes in this patch: * basic **

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: YARN-9440.001.patch > Improve diagnostics for scheduler and app activities >

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: (was: YARN-9440.001.patch) > Improve diagnostics for scheduler and app activities >

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-09 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: YARN-9440.001.patch > Improve diagnostics for scheduler and app activities >

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-09 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813997#comment-16813997 ] Tao Yang commented on YARN-9439: Hi, [~cheersyang]. Findbugs warnings are not related to this patch. They

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-09 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813306#comment-16813306 ] Tao Yang commented on YARN-9439: Attached v3 patch to fix UT errors. > Support asynchronized scheduling

[jira] [Updated] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-09 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9439: --- Attachment: YARN-9439.003.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-08 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812400#comment-16812400 ] Tao Yang commented on YARN-9313: Thanks [~cheersyang] for the review and commit! I have submitted the

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812110#comment-16812110 ] Tao Yang commented on YARN-9413: The checkstyle issue seems the same as above and UT failures are not

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812056#comment-16812056 ] Tao Yang commented on YARN-9313: Attached v5 patch to fix remaining checkstyle errors, UT and findbugs

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.005.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Commented] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811744#comment-16811744 ] Tao Yang commented on YARN-9050: Hi, [~adam.antal]. As far as I know, currently activities is only used by

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.004.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811725#comment-16811725 ] Tao Yang commented on YARN-9313: Attached v4 patch. Thanks [~cheersyang] for your advices. > Support

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811729#comment-16811729 ] Tao Yang commented on YARN-9413: Thanks [~cheersyang], [~snemeth] for the review and commit. {quote} could

[jira] [Updated] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-04-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9413: --- Attachment: YARN-9413.branch-3.0.001.patch > Queue resource leak after app fail for CapacityScheduler >

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810428#comment-16810428 ] Tao Yang commented on YARN-9439: This patch is dependent on YARN-9313, I think the patch should wait (not

[jira] [Updated] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9439: --- Attachment: YARN-9439.002.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Comment Edited] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809881#comment-16809881 ] Tao Yang edited comment on YARN-9313 at 4/4/19 2:04 PM: There are some basic

[jira] [Commented] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809881#comment-16809881 ] Tao Yang commented on YARN-9313: There are some basic modifications on trunk recently (for example: log4j

[jira] [Updated] (YARN-9313) Support asynchronized scheduling mode and multi-node lookup mechanism for scheduler activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9313: --- Attachment: YARN-9313.003.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Description: [Design

[jira] [Updated] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9439: --- Description: [Design

[jira] [Created] (YARN-9440) Improve diagnostics for scheduler and app activities

2019-04-04 Thread Tao Yang (JIRA)
Tao Yang created YARN-9440: -- Summary: Improve diagnostics for scheduler and app activities Key: YARN-9440 URL: https://issues.apache.org/jira/browse/YARN-9440 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9439: --- Attachment: YARN-9439.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Created] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

2019-04-04 Thread Tao Yang (JIRA)
Tao Yang created YARN-9439: -- Summary: Support asynchronized scheduling mode and multi-node lookup mechanism for app activities Key: YARN-9439 URL: https://issues.apache.org/jira/browse/YARN-9439 Project:

[jira] [Updated] (YARN-9432) Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled

2019-04-02 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9432: --- Attachment: YARN-9432.002.patch > Excess reserved containers may exist for a long time after its request has

[jira] [Commented] (YARN-9432) Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled

2019-04-02 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807475#comment-16807475 ] Tao Yang commented on YARN-9432: Attached v2 patch to fix check-style error and UT failures. > Excess

[jira] [Updated] (YARN-9432) Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled

2019-04-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9432: --- Attachment: YARN-9432.001.patch > Excess reserved containers may exist for a long time after its request has

[jira] [Updated] (YARN-9432) Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled

2019-04-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9432: --- Attachment: (was: YARN-9432.001.patch) > Excess reserved containers may exist for a long time after its

[jira] [Commented] (YARN-9432) Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled

2019-04-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806676#comment-16806676 ] Tao Yang commented on YARN-9432: Attached v1 patch for review. > Excess reserved containers may exist for

[jira] [Updated] (YARN-9432) Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled

2019-04-01 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9432: --- Attachment: YARN-9432.001.patch > Excess reserved containers may exist for a long time after its request has

[jira] [Created] (YARN-9432) Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled

2019-04-01 Thread Tao Yang (JIRA)
Tao Yang created YARN-9432: -- Summary: Excess reserved containers may exist for a long time after its request has been cancelled or satisfied when multi-nodes enabled Key: YARN-9432 URL:

[jira] [Updated] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

2019-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9423: --- Description: We have met a slow recovery for applications after many NM lost: # many NM shut down at the

[jira] [Commented] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

2019-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804680#comment-16804680 ] Tao Yang commented on YARN-9423: Attached v1 patch for review.  Please feel free to give your suggestions.

[jira] [Updated] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

2019-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9423: --- Attachment: YARN-9423.001.patch > Optimize AM launcher to avoid bottleneck when a large number of AM failover

[jira] [Updated] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

2019-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9423: --- Attachment: (was: YARN-9423.001.patch) > Optimize AM launcher to avoid bottleneck when a large number of

[jira] [Updated] (YARN-9423) Optimize AM launcher to avoid bottleneck when a large number of AM failover happen at the same time

2019-03-29 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9423: --- Attachment: YARN-9423.001.patch > Optimize AM launcher to avoid bottleneck when a large number of AM failover

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804589#comment-16804589 ] Tao Yang commented on YARN-9413: Thanks [~cheersyang] for the confirmation about the checkstyle error.

[jira] [Updated] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9413: --- Attachment: YARN-9413.003.patch > Queue resource leak after app fail for CapacityScheduler >

[jira] [Commented] (YARN-9413) Queue resource leak after app fail for CapacityScheduler

2019-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804536#comment-16804536 ] Tao Yang commented on YARN-9413: Thanks [~cheersyang], [~snemeth] for your suggestions.

<    1   2   3   4   5   6   7   8   9   10   >