[jira] [Created] (YARN-9798) ApplicationMasterServiceTestBase#testRepeatedFinishApplicationMaster fails intermittently

Tao Yang created YARN-9798: -- Summary: ApplicationMasterServiceTestBase#testRepeatedFinishApplicationMaster fails intermittently Key: YARN-9798 URL: https://issues.apache.org/jira/browse/YARN-9798 Project:

[jira] [Commented] (YARN-9540) TestRMAppTransitions fails intermittently

[ https://issues.apache.org/jira/browse/YARN-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919097#comment-16919097 ] Tao Yang commented on YARN-9540: Hi, [~adam.antal]. The cause is that the assertion which will make sure

[jira] [Comment Edited] (YARN-9540) TestRMAppTransitions fails intermittently

[ https://issues.apache.org/jira/browse/YARN-9540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919097#comment-16919097 ] Tao Yang edited comment on YARN-9540 at 8/30/19 2:00 AM: - Hi, [~adam.antal]. The

[jira] [Resolved] (YARN-9803) NPE while accessing Scheduler UI

[ https://issues.apache.org/jira/browse/YARN-9803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang resolved YARN-9803. Resolution: Duplicate Hi, [~yifan.stan]. This is a duplicate of YARN-9685, closing it as duplicate. > NPE

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16919204#comment-16919204 ] Tao Yang commented on YARN-9714: Thanks [~rohithsharma], [~bibinchundatt] for the review and commit! >

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915511#comment-16915511 ] Tao Yang commented on YARN-8917: Sorry for this late reply. I will check it shortly. > Absolute (maximum)

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915522#comment-16915522 ] Tao Yang commented on YARN-9714: Thanks [~rohithsharma] for the comment. We are using hadoop-3.1 right

[jira] [Commented] (YARN-9779) NPE while allocating a container

[ https://issues.apache.org/jira/browse/YARN-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915684#comment-16915684 ] Tao Yang commented on YARN-9779: Sorry for the late reply. I think this issue is duplicate with YARN-8193.

[jira] [Issue Comment Deleted] (YARN-9779) NPE while allocating a container

[ https://issues.apache.org/jira/browse/YARN-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9779: --- Comment: was deleted (was: Sorry for the late reply. I think this issue is duplicate with YARN-8193.) > NPE

[jira] [Commented] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915685#comment-16915685 ] Tao Yang commented on YARN-8193: Hi, [~sunilg], [~leftnoteasy]. Any updates or plans about this fix on

[jira] [Updated] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9714: --- Attachment: YARN-9714.003.patch > ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915598#comment-16915598 ] Tao Yang commented on YARN-9714: Hi, [~rohithsharma]. I have commented (over

[jira] [Comment Edited] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915598#comment-16915598 ] Tao Yang edited comment on YARN-9714 at 8/26/19 8:45 AM: - Hi, [~rohithsharma]. I

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915628#comment-16915628 ] Tao Yang commented on YARN-8917: Hi, [~rohithsharma], I can't reproduce this failure on trunk branch in my

[jira] [Comment Edited] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915598#comment-16915598 ] Tao Yang edited comment on YARN-9714 at 8/26/19 8:43 AM: - Hi, [~rohithsharma]. I

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915625#comment-16915625 ] Tao Yang commented on YARN-9714: We can close the connection after checking {{zkManager !=

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16920568#comment-16920568 ] Tao Yang commented on YARN-8995: Thanks [~zhuqi] for the update. Patch LGTM, could you please also fix the

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16914048#comment-16914048 ] Tao Yang commented on YARN-8995: Thanks [~cheersyang] for the review. I agree that 'in-thousands' should

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918273#comment-16918273 ] Tao Yang commented on YARN-9714: Hi, [~rohithsharma]. UT log is filled with these errors:

[jira] [Commented] (YARN-9664) Improve response of scheduler/app activities for better understanding

[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918247#comment-16918247 ] Tao Yang commented on YARN-9664: Thanks [~cheersyang] for the review. {quote} ActivitiesUtils Line 56: I

[jira] [Updated] (YARN-9664) Improve response of scheduler/app activities for better understanding

[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9664: --- Attachment: YARN-9664.003.patch > Improve response of scheduler/app activities for better understanding >

[jira] [Commented] (YARN-9664) Improve response of scheduler/app activities for better understanding

[ https://issues.apache.org/jira/browse/YARN-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918321#comment-16918321 ] Tao Yang commented on YARN-9664: Thanks [~cheersyang] for the advice. Attached v3 patch. > Improve

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922279#comment-16922279 ] Tao Yang commented on YARN-8995: Confirmed that latest patch should not fail like that. Now the patch

[jira] [Commented] (YARN-9795) ClusterMetrics to include AM allocation delay

[ https://issues.apache.org/jira/browse/YARN-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923891#comment-16923891 ] Tao Yang commented on YARN-9795: +1 for the latest patch. I will commit this if no further comments from

[jira] [Commented] (YARN-9795) ClusterMetrics to include AM allocation delay

[ https://issues.apache.org/jira/browse/YARN-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923882#comment-16923882 ] Tao Yang commented on YARN-9795: Thanks [~fengnanli] for the update. A small suggestion is to remove null

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16922996#comment-16922996 ] Tao Yang commented on YARN-8995: Hi, [~zhuqi], I found another place need to be improved. {{ if (qSize %

[jira] [Commented] (YARN-9795) ClusterMetrics to include AM allocation delay

[ https://issues.apache.org/jira/browse/YARN-9795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923024#comment-16923024 ] Tao Yang commented on YARN-9795: Thanks [~fengnanli] for this improvement. Patch almost LGTM, IMO,

[jira] [Commented] (YARN-8995) Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time.

[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924672#comment-16924672 ] Tao Yang commented on YARN-8995: Thanks [~jhung] for fixing this problem, sorry for missing changes about

[jira] [Commented] (YARN-9817) Fix failing testcases due to not initialized AsyncDispatcher - ArithmeticException: / by zero

[ https://issues.apache.org/jira/browse/YARN-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924659#comment-16924659 ] Tao Yang commented on YARN-9817: Thanks [~Prabhu Joseph] for raising this issue. Patch LGTM, committing

[jira] [Comment Edited] (YARN-8995) Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time.

[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924672#comment-16924672 ] Tao Yang edited comment on YARN-8995 at 9/7/19 12:33 AM: - Thanks [~jhung] for

[jira] [Updated] (YARN-9714) Memory leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9714: --- Attachment: YARN-9714.001.patch > Memory leaks after RM transitioned to standby >

[jira] [Created] (YARN-9714) Memory leaks after RM transitioned to standby

Tao Yang created YARN-9714: -- Summary: Memory leaks after RM transitioned to standby Key: YARN-9714 URL: https://issues.apache.org/jira/browse/YARN-9714 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9714: --- Summary: ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby (was: Memory leaks

[jira] [Commented] (YARN-9714) Memory leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896007#comment-16896007 ] Tao Yang commented on YARN-9714: Attached v1 patch for review. cc: [~cheersyang], [~sunil.g],

[jira] [Updated] (YARN-9714) Memory leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9714: --- Attachment: YARN-9714.002.patch > Memory leaks after RM transitioned to standby >

[jira] [Commented] (YARN-9714) Memory leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896034#comment-16896034 ] Tao Yang commented on YARN-9714: Thanks [~bibinchundatt] for the remind. Yes, it should be moved to

[jira] [Commented] (YARN-9642) AbstractYarnScheduler#clearPendingContainerCache could run even after transitiontostandby

[ https://issues.apache.org/jira/browse/YARN-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896074#comment-16896074 ] Tao Yang commented on YARN-9642: Thanks [~bibinchundatt] for this fix. +1 for the patch. >

[jira] [Comment Edited] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896704#comment-16896704 ] Tao Yang edited comment on YARN-9714 at 7/31/19 2:29 AM: - Hi, [~bibinchundatt].

[jira] [Comment Edited] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896704#comment-16896704 ] Tao Yang edited comment on YARN-9714 at 7/31/19 2:21 AM: - Hi, [~bibinchundatt].

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896704#comment-16896704 ] Tao Yang commented on YARN-9714: Hi, [~bibinchundatt]. {quote} IIUC the zookeer StateStore is not an

[jira] [Commented] (YARN-9685) NPE when rendering the info table of leaf queue in non-accessible partitions

[ https://issues.apache.org/jira/browse/YARN-9685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903501#comment-16903501 ] Tao Yang commented on YARN-9685: Thanks [~eepayne] for the review and commit! > NPE when rendering the

[jira] [Commented] (YARN-9716) AM container might leak

[ https://issues.apache.org/jira/browse/YARN-9716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903526#comment-16903526 ] Tao Yang commented on YARN-9716: Hi, [~vinodkv], could you please take a look at this issue?  > AM

[jira] [Commented] (YARN-9687) Queue headroom check may let unacceptable allocation off when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-9687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890952#comment-16890952 ] Tao Yang commented on YARN-9687: Thanks [~cheersyang], [~sunilg] for the review and comments. UT failure

[jira] [Commented] (YARN-9490) applicationresourceusagereport return wrong number of reserved containers

[ https://issues.apache.org/jira/browse/YARN-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887683#comment-16887683 ] Tao Yang commented on YARN-9490: Hi, [~zyb]. Any updates about this patch?  >

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888451#comment-16888451 ] Tao Yang commented on YARN-8995: Hi, [~zhuqi], sorry for my late reply.  LGTM. +1 for the patch. I will

[jira] [Created] (YARN-9685) NPE when rendering the info table of leaf queue in non-accessible partitions

Tao Yang created YARN-9685: -- Summary: NPE when rendering the info table of leaf queue in non-accessible partitions Key: YARN-9685 URL: https://issues.apache.org/jira/browse/YARN-9685 Project: Hadoop YARN

[jira] [Updated] (YARN-9685) NPE when rendering the info table of leaf queue in non-accessible partitions

[ https://issues.apache.org/jira/browse/YARN-9685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9685: --- Attachment: YARN-9685.001.patch > NPE when rendering the info table of leaf queue in non-accessible

[jira] [Commented] (YARN-9685) NPE when rendering the info table of leaf queue in non-accessible partitions

[ https://issues.apache.org/jira/browse/YARN-9685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888629#comment-16888629 ] Tao Yang commented on YARN-9685: Attached v1 patch to fix related places to take care of that scenarios.

[jira] [Updated] (YARN-9685) NPE when rendering the info table of leaf queue in non-accessible partitions

[ https://issues.apache.org/jira/browse/YARN-9685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9685: --- Affects Version/s: 3.3.0 > NPE when rendering the info table of leaf queue in non-accessible partitions >

[jira] [Created] (YARN-9686) Reduce visibility of blacklisted nodes information (only for current app attempt) to avoid the abuse of memory

Tao Yang created YARN-9686: -- Summary: Reduce visibility of blacklisted nodes information (only for current app attempt) to avoid the abuse of memory Key: YARN-9686 URL: https://issues.apache.org/jira/browse/YARN-9686

[jira] [Updated] (YARN-9686) Reduce visibility of blacklisted nodes information (only for current app attempt) to avoid the abuse of memory

[ https://issues.apache.org/jira/browse/YARN-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9686: --- Attachment: YARN-9686.001.patch > Reduce visibility of blacklisted nodes information (only for current app >

[jira] [Commented] (YARN-9686) Reduce visibility of blacklisted nodes information (only for current app attempt) to avoid the abuse of memory

[ https://issues.apache.org/jira/browse/YARN-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888758#comment-16888758 ] Tao Yang commented on YARN-9686: Attached v1 patch for review. > Reduce visibility of blacklisted nodes

[jira] [Created] (YARN-9687) Queue headroom check may let unacceptable allocation off when using DominantResourceCalculator

Tao Yang created YARN-9687: -- Summary: Queue headroom check may let unacceptable allocation off when using DominantResourceCalculator Key: YARN-9687 URL: https://issues.apache.org/jira/browse/YARN-9687

[jira] [Updated] (YARN-9687) Queue headroom check may let unacceptable allocation off when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-9687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9687: --- Attachment: YARN-9687.001.patch > Queue headroom check may let unacceptable allocation off when using >

[jira] [Commented] (YARN-9687) Queue headroom check may let unacceptable allocation off when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-9687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1631#comment-1631 ] Tao Yang commented on YARN-9687: Attached v1 patch with UT for review. [~cheersyang], could you please

[jira] [Comment Edited] (YARN-9687) Queue headroom check may let unacceptable allocation off when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-9687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1631#comment-1631 ] Tao Yang edited comment on YARN-9687 at 7/19/19 12:48 PM: -- Attached v1 patch with

[jira] [Commented] (YARN-9635) Nodes page displayed duplicate nodes

[ https://issues.apache.org/jira/browse/YARN-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886643#comment-16886643 ] Tao Yang commented on YARN-9635: Thanks [~jiwq] for the patch and sorry for my late reply.  Another

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863691#comment-16863691 ] Tao Yang commented on YARN-9567: Thanks [~cheersyang]. Attached v1 patch for review. > Add diagnostics

[jira] [Updated] (YARN-9623) Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

[ https://issues.apache.org/jira/browse/YARN-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9623: --- Summary: Auto adjust max queue length of app activities to make sure activities on all nodes can be covered

[jira] [Commented] (YARN-8737) Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile

[ https://issues.apache.org/jira/browse/YARN-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952049#comment-16952049 ] Tao Yang commented on YARN-8737: Thanks [~cheersyang] for the review. Submitted already. > Race condition

[jira] [Commented] (YARN-8737) Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile

[ https://issues.apache.org/jira/browse/YARN-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951552#comment-16951552 ] Tao Yang commented on YARN-8737: Thanks [~Amithsha] for the feedback. Sorry to have forgot this issue for

[jira] [Comment Edited] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957845#comment-16957845 ] Tao Yang edited comment on YARN-7621 at 10/23/19 12:51 PM: --- Hi, [~cane]. Sorry

[jira] [Comment Edited] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957845#comment-16957845 ] Tao Yang edited comment on YARN-7621 at 10/23/19 12:48 PM: --- Hi, [~cane]. Sorry

[jira] [Commented] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16957845#comment-16957845 ] Tao Yang commented on YARN-7621: Hi, [~cane]. Sorry for the late reply. It's make perfect sense for me to

[jira] [Updated] (YARN-9838) Fix resource inconsistency for queues when moving app with reserved container to another queue

[ https://issues.apache.org/jira/browse/YARN-9838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9838: --- Summary: Fix resource inconsistency for queues when moving app with reserved container to another queue

[jira] [Updated] (YARN-9838) Fix resource inconsistency for queues when moving app with reserved container to another queue

[ https://issues.apache.org/jira/browse/YARN-9838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9838: --- Fix Version/s: 3.1.4 3.2.2 2.9.3 3.3.0 > Fix

[jira] [Commented] (YARN-9958) Remove the invalid lock in ContainerExecutor

[ https://issues.apache.org/jira/browse/YARN-9958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974079#comment-16974079 ] Tao Yang commented on YARN-9958: Thanks [~jiwq] for this improvement. Patch LGTM, the related r/w lock

[jira] [Commented] (YARN-9635) Nodes page displayed duplicate nodes

[ https://issues.apache.org/jira/browse/YARN-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974098#comment-16974098 ] Tao Yang commented on YARN-9635: Hi, [~jiwq]. I think the description of conf in NodeManager.md is not

[jira] [Commented] (YARN-9838) Using the CapacityScheduler,Apply "movetoqueue" on the application which CS reserved containers for,will cause "Num Container" and "Used Resource" in ResourceUsage metri

[ https://issues.apache.org/jira/browse/YARN-9838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950671#comment-16950671 ] Tao Yang commented on YARN-9838: Thanks [~jiulongZhu] for updating the patch. LGTM, +1 for the patch.

[jira] [Comment Edited] (YARN-9838) Using the CapacityScheduler,Apply "movetoqueue" on the application which CS reserved containers for,will cause "Num Container" and "Used Resource" in ResourceUsage

[ https://issues.apache.org/jira/browse/YARN-9838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950671#comment-16950671 ] Tao Yang edited comment on YARN-9838 at 10/14/19 3:17 AM: -- Thanks [~jiulongZhu] 

[jira] [Commented] (YARN-9838) Using the CapacityScheduler,Apply "movetoqueue" on the application which CS reserved containers for,will cause "Num Container" and "Used Resource" in ResourceUsage metri

[ https://issues.apache.org/jira/browse/YARN-9838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949330#comment-16949330 ] Tao Yang commented on YARN-9838: Thanks [~jiulongZhu] for fixing this issue. The patch is LGTM in

[jira] [Updated] (YARN-9838) Using the CapacityScheduler,Apply "movetoqueue" on the application which CS reserved containers for,will cause "Num Container" and "Used Resource" in ResourceUsage metrics

[ https://issues.apache.org/jira/browse/YARN-9838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9838: --- Fix Version/s: (was: 2.7.3) > Using the CapacityScheduler,Apply "movetoqueue" on the application which CS

[jira] [Updated] (YARN-9838) Using the CapacityScheduler,Apply "movetoqueue" on the application which CS reserved containers for,will cause "Num Container" and "Used Resource" in ResourceUsage metrics

[ https://issues.apache.org/jira/browse/YARN-9838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9838: --- Issue Type: Bug (was: Improvement) > Using the CapacityScheduler,Apply "movetoqueue" on the application

[jira] [Comment Edited] (YARN-9838) Using the CapacityScheduler,Apply "movetoqueue" on the application which CS reserved containers for,will cause "Num Container" and "Used Resource" in ResourceUsage

[ https://issues.apache.org/jira/browse/YARN-9838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16949330#comment-16949330 ] Tao Yang edited comment on YARN-9838 at 10/11/19 10:02 AM: --- Thanks [~jiulongZhu]

[jira] [Updated] (YARN-9538) Document scheduler/app activities and REST APIs

[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9538: --- Attachment: YARN-9538.004.patch > Document scheduler/app activities and REST APIs >

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019278#comment-17019278 ] Tao Yang commented on YARN-9538: Thanks [~cheersyang] for the review. Attached v4 patch to fix failures

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: YARN-9567.004.patch > Add diagnostics for outstanding resource requests on app attempts page >

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029648#comment-17029648 ] Tao Yang commented on YARN-9567: Thanks [~cheersyang] for the review. It seems that wrong file was taken

[jira] [Commented] (YARN-10151) Disable Capacity Scheduler's move app between queue functionality

[ https://issues.apache.org/jira/browse/YARN-10151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039665#comment-17039665 ] Tao Yang commented on YARN-10151: - Hi, [~leftnoteasy] FYI, a related issue which can make that happen

[jira] [Updated] (YARN-9538) Document scheduler/app activities and REST APIs

[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9538: --- Attachment: YARN-9538.002.patch > Document scheduler/app activities and REST APIs >

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011387#comment-17011387 ] Tao Yang commented on YARN-9538: Attached v2 patch which have been checked via hugo in my local test

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011505#comment-17011505 ] Tao Yang commented on YARN-9538: Thanks [~cheersyang] for finding out mistakes and providing better

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011789#comment-17011789 ] Tao Yang commented on YARN-9567: Thanks [~cheersyang] for the review. {quote} 1. since this is a CS only

[jira] [Updated] (YARN-9538) Document scheduler/app activities and REST APIs

[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9538: --- Attachment: YARN-9538.003.patch > Document scheduler/app activities and REST APIs >

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011781#comment-17011781 ] Tao Yang commented on YARN-9538: Attached v3 patch in which most comments are addressed, updates need more

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: (was: YARN-9567.003.patch) > Add diagnostics for outstanding resource requests on app

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: YARN-9567.003.patch > Add diagnostics for outstanding resource requests on app attempts page >

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: YARN-9567.003.patch > Add diagnostics for outstanding resource requests on app attempts page >

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: scheduler-activities-example.png > Add diagnostics for outstanding resource requests on app

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17019208#comment-17019208 ] Tao Yang commented on YARN-9567: Thanks [~cheersyang] for the review. I have attached V3 patch with

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: app-activities-example.png > Add diagnostics for outstanding resource requests on app attempts

[jira] [Commented] (YARN-7007) NPE in RM while using YarnClient.getApplications()

[ https://issues.apache.org/jira/browse/YARN-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012554#comment-17012554 ] Tao Yang commented on YARN-7007: [~fly_in_gis], thanks for the feedback, I will cherry-pick this fix to

[jira] [Updated] (YARN-7007) NPE in RM while using YarnClient.getApplications()

[ https://issues.apache.org/jira/browse/YARN-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7007: --- Fix Version/s: 2.8.6 > NPE in RM while using YarnClient.getApplications() >

[jira] [Commented] (YARN-7007) NPE in RM while using YarnClient.getApplications()

[ https://issues.apache.org/jira/browse/YARN-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012615#comment-17012615 ] Tao Yang commented on YARN-7007: Already cherry-picked this fix to branch-2.8 > NPE in RM while using

[jira] [Commented] (YARN-10059) Final states of failed-to-localize containers are not recorded in NM state store

[ https://issues.apache.org/jira/browse/YARN-10059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002700#comment-17002700 ] Tao Yang commented on YARN-10059: - Attached v1 patch for review. > Final states of failed-to-localize

[jira] [Updated] (YARN-10059) Final states of failed-to-localize containers are not recorded in NM state store

[ https://issues.apache.org/jira/browse/YARN-10059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-10059: Attachment: YARN-10059.001.patch > Final states of failed-to-localize containers are not recorded in NM

[jira] [Created] (YARN-10059) Final states of failed-to-localize containers are not recorded in NM state store

Tao Yang created YARN-10059: --- Summary: Final states of failed-to-localize containers are not recorded in NM state store Key: YARN-10059 URL: https://issues.apache.org/jira/browse/YARN-10059 Project: Hadoop

[jira] [Updated] (YARN-10059) Final states of failed-to-localize containers are not recorded in NM state store

[ https://issues.apache.org/jira/browse/YARN-10059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-10059: Attachment: (was: YARN-10059.001.patch) > Final states of failed-to-localize containers are not

[jira] [Updated] (YARN-10059) Final states of failed-to-localize containers are not recorded in NM state store

[ https://issues.apache.org/jira/browse/YARN-10059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-10059: Attachment: YARN-10059.001.patch > Final states of failed-to-localize containers are not recorded in NM

[jira] [Commented] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17010339#comment-17010339 ] Tao Yang commented on YARN-9050: Glad to hear that 3.3.0 release is on the way and thanks for reminding

<    4   5   6   7   8   9   10   >