[jira] [Updated] (YARN-11683) RM crash due to RELEASE_CONTAINER NPE

[ https://issues.apache.org/jira/browse/YARN-11683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11683: Affects Version/s: 3.4.0 > RM crash due to RELEASE_CONTAINER NPE > - >

[jira] [Updated] (YARN-11683) RM crash due to RELEASE_CONTAINER NPE

[ https://issues.apache.org/jira/browse/YARN-11683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11683: Description: We enable scheduleAsynchronously in our prod env, RM crash and throw exception stack below:

[jira] [Created] (YARN-11683) RM crash due to RELEASE_CONTAINER NPE

Yuan Luo created YARN-11683: --- Summary: RM crash due to RELEASE_CONTAINER NPE Key: YARN-11683 URL: https://issues.apache.org/jira/browse/YARN-11683 Project: Hadoop YARN Issue Type: Bug

[jira] [Comment Edited] (YARN-11663) Router cache expansion issue

[ https://issues.apache.org/jira/browse/YARN-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827323#comment-17827323 ] Yuan Luo edited comment on YARN-11663 at 3/15/24 2:51 AM: -- [~slfan1989] Thanks

[jira] [Commented] (YARN-11663) Router cache expansion issue

[ https://issues.apache.org/jira/browse/YARN-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827323#comment-17827323 ] Yuan Luo commented on YARN-11663: - Our cache setting is 60 seconds, and memory recycling is triggered by

[jira] [Updated] (YARN-11663) Router cache expansion issue

[ https://issues.apache.org/jira/browse/YARN-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11663: Attachment: image-2024-03-15-10-50-32-860.png > Router cache expansion issue >

[jira] [Updated] (YARN-11663) Router cache expansion issue

[ https://issues.apache.org/jira/browse/YARN-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11663: Description: !image-2024-03-14-18-12-28-426.png! !image-2024-03-14-18-12-49-950.png! hi [~slfan1989]

[jira] [Updated] (YARN-11663) Router cache expansion issue

[ https://issues.apache.org/jira/browse/YARN-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11663: Affects Version/s: 3.4.0 (was: 3.3.6) > Router cache expansion issue >

[jira] [Updated] (YARN-11663) Router cache expansion issue

[ https://issues.apache.org/jira/browse/YARN-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11663: Attachment: image-2024-03-14-18-12-28-426.png > Router cache expansion issue >

[jira] [Updated] (YARN-11663) Router cache expansion issue

[ https://issues.apache.org/jira/browse/YARN-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11663: Attachment: image-2024-03-14-18-12-49-950.png > Router cache expansion issue >

[jira] [Updated] (YARN-11663) Router cache expansion issue

[ https://issues.apache.org/jira/browse/YARN-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11663: Component/s: federation > Router cache expansion issue > > >

[jira] [Created] (YARN-11663) Router cache expansion issue

Yuan Luo created YARN-11663: --- Summary: Router cache expansion issue Key: YARN-11663 URL: https://issues.apache.org/jira/browse/YARN-11663 Project: Hadoop YARN Issue Type: Bug Components:

[jira] [Commented] (YARN-10885) Make FederationStateStoreFacade#getApplicationHomeSubCluster use JCache

[ https://issues.apache.org/jira/browse/YARN-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827033#comment-17827033 ] Yuan Luo commented on YARN-10885: - !image-2024-03-14-18-02-21-278.png!

[jira] [Commented] (YARN-11191) Global Scheduler refreshQueue cause deadLock

[ https://issues.apache.org/jira/browse/YARN-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17578409#comment-17578409 ] Yuan Luo commented on YARN-11191: -   {code:java} public class ThreadLockTest { private static

[jira] [Commented] (YARN-11191) Global Scheduler refreshQueue cause deadLock

[ https://issues.apache.org/jira/browse/YARN-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577784#comment-17577784 ] Yuan Luo commented on YARN-11191: -  I want to ask two question: +  @Override +  public List

[jira] [Commented] (YARN-11191) Global Scheduler refreshQueue cause deadLock

[ https://issues.apache.org/jira/browse/YARN-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577178#comment-17577178 ] Yuan Luo commented on YARN-11191: - We meet a same issue when refresh yarn queue, the refresh thread stuck

[jira] [Commented] (YARN-11115) Add configuration to disable AM preemption for capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539406#comment-17539406 ] Yuan Luo commented on YARN-5: - any update for this ticket？ [~zuston]  > Add configuration to disable

[jira] [Commented] (YARN-11115) Add configuration to disable AM preemption for capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-5?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17528508#comment-17528508 ] Yuan Luo commented on YARN-5: - [~zuston]  If you can help do that, that would be great. > Add

[jira] [Created] (YARN-11115) Add configuration to disable AM preemption for capacity scheduler

Yuan Luo created YARN-5: --- Summary: Add configuration to disable AM preemption for capacity scheduler Key: YARN-5 URL: https://issues.apache.org/jira/browse/YARN-5 Project: Hadoop YARN

[jira] [Commented] (YARN-10934) LeafQueue activateApplications NPE

[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17493631#comment-17493631 ] Yuan Luo commented on YARN-10934: - After applying this patch to our cluster, the problem was fixed. Thank

[jira] [Updated] (YARN-11012) Add version and process startup time on Router web page

[ https://issues.apache.org/jira/browse/YARN-11012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11012: Description: Router web page should show hadoop version and startup time like other YARN componment, so

[jira] [Updated] (YARN-11012) Add version and process startup time on Router web page

[ https://issues.apache.org/jira/browse/YARN-11012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11012: Description: Router web page should show hadoop version and startup time like other YARN componment, so

[jira] [Updated] (YARN-11012) Add version and process startup time on Router web page

[ https://issues.apache.org/jira/browse/YARN-11012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11012: Attachment: image-2021-11-22-18-53-32-007.png > Add version and process startup time on Router web page >

[jira] [Updated] (YARN-11012) Add version and process startup time on Router web page

[ https://issues.apache.org/jira/browse/YARN-11012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11012: Description: Router web page should show hadoop version and startup time like other YARN componment, so

[jira] [Updated] (YARN-11012) Add version and process startup time on Router web page

[ https://issues.apache.org/jira/browse/YARN-11012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11012: Description: Router web page should show hadoop version and startup time like other YARN componment, so

[jira] [Created] (YARN-11012) Add version and process startup time on Router web page

Yuan Luo created YARN-11012: --- Summary: Add version and process startup time on Router web page Key: YARN-11012 URL: https://issues.apache.org/jira/browse/YARN-11012 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Fix Version/s: 3.4.0 > Make YARN Router throw Exception to client clearly >

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Description: When router submits job to yarn, the job is rejected by yarn for some reason. Yarn router

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Description: When router submits job to yarn, the job is rejected by yarn for some reason. Yarn router

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Description: When router submits job to yarn, the job is rejected by yarn for some reason. Yarn router

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Attachment: router-error.png > Make YARN Router throw Exception to client clearly >

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Description: When router submits job to yarn, the job is rejected by yarn for some reason. Yarn router

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Description: When router submits job to yarn, the job is rejected by yarn for some reason. Yarn router

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Attachment: router-error.png > Make YARN Router throw Exception to client clearly >

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Attachment: (was: router-error.png) > Make YARN Router throw Exception to client clearly >

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Description: When router submits job to yarn, the job is rejected by yarn for some reason. Yarn router

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Description: When router submits job to yarn, the job is rejected by yarn for some reason. Yarn router

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Attachment: (was: screenshot-1.png) > Make YARN Router throw Exception to client clearly >

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Attachment: (was: screenshot-2.png) > Make YARN Router throw Exception to client clearly >

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Attachment: screenshot-1.png > Make YARN Router throw Exception to client clearly >

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Description: When router submits job to yarn, the job is rejected by yarn for some reason. Yarn router

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Description: When router submits job to yarn, the job is rejected by yarn for some reason. Yarn router

[jira] [Updated] (YARN-11011) Make YARN Router throw Exception to client clearly

[ https://issues.apache.org/jira/browse/YARN-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-11011: Attachment: screenshot-2.png > Make YARN Router throw Exception to client clearly >

[jira] [Created] (YARN-11011) Make YARN Router throw Exception to client clearly

Yuan Luo created YARN-11011: --- Summary: Make YARN Router throw Exception to client clearly Key: YARN-11011 URL: https://issues.apache.org/jira/browse/YARN-11011 Project: Hadoop YARN Issue Type:

[jira] [Comment Edited] (YARN-10934) LeafQueue activateApplications NPE

[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411636#comment-17411636 ] Yuan Luo edited comment on YARN-10934 at 9/8/21, 7:26 AM: -- [~snemeth] Thanks for

[jira] [Updated] (YARN-10934) LeafQueue activateApplications NPE

[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-10934: Attachment: (was: RM-capacity-scheduler.xml) > LeafQueue activateApplications NPE >

[jira] [Updated] (YARN-10934) LeafQueue activateApplications NPE

[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-10934: Attachment: RM-capacity-scheduler.xml > LeafQueue activateApplications NPE >

[jira] [Updated] (YARN-10934) LeafQueue activateApplications NPE

[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-10934: Attachment: RM-capacity-scheduler.xml > LeafQueue activateApplications NPE >

[jira] [Updated] (YARN-10934) LeafQueue activateApplications NPE

[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-10934: Attachment: (was: RM-capacity-scheduler.xml) > LeafQueue activateApplications NPE >

[jira] [Updated] (YARN-10934) LeafQueue activateApplications NPE

[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Luo updated YARN-10934: Attachment: RM-capacity-scheduler.xml RM-yarn-site.xml > LeafQueue activateApplications

[jira] [Updated] (YARN-10934) LeafQueue activateApplications NPE

[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan LUO updated YARN-10934: Summary: LeafQueue activateApplications NPE (was: activateApplications NPE) > LeafQueue

[jira] [Commented] (YARN-10934) activateApplications NPE

[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411636#comment-17411636 ] Yuan LUO commented on YARN-10934: - [~snemeth] Thanks for your reply, have fixed title, it is a NPE Error.

[jira] [Updated] (YARN-10934) activateApplications NPE

[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan LUO updated YARN-10934: Summary: activateApplications NPE (was: activateApplications NPL) > activateApplications NPE >

[jira] [Commented] (YARN-10934) activateApplications NPL

[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17411200#comment-17411200 ] Yuan LUO commented on YARN-10934: - Hi [~zhuqi] [~gandras] [~bteke] [~taoyang] Could you have a look at

[jira] [Updated] (YARN-10934) activateApplications NPL

[ https://issues.apache.org/jira/browse/YARN-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan LUO updated YARN-10934: Description: Our prod Yarn cluster is hadoop version 3.3.1 , we changed DefaultResourceCalculator ->

[jira] [Created] (YARN-10934) activateApplications NPL

Yuan LUO created YARN-10934: --- Summary: activateApplications NPL Key: YARN-10934 URL: https://issues.apache.org/jira/browse/YARN-10934 Project: Hadoop YARN Issue Type: Bug Components: RM

[jira] [Updated] (YARN-10774) Federation: Normalize the yarn federation queue name

[ https://issues.apache.org/jira/browse/YARN-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan LUO updated YARN-10774: Attachment: YARN-10774.003.patch > Federation: Normalize the yarn federation queue name >

[jira] [Comment Edited] (YARN-10774) Federation: Normalize the yarn federation queue name

[ https://issues.apache.org/jira/browse/YARN-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347464#comment-17347464 ] Yuan LUO edited comment on YARN-10774 at 5/19/21, 9:49 AM: --- Thanks for your

[jira] [Commented] (YARN-10774) Federation: Normalize the yarn federation queue name

[ https://issues.apache.org/jira/browse/YARN-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17347464#comment-17347464 ] Yuan LUO commented on YARN-10774: - Thanks for your reply [~zhuqi] :) This Patch

[jira] [Updated] (YARN-10774) Federation: Normalize the yarn federation queue name

[ https://issues.apache.org/jira/browse/YARN-10774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan LUO updated YARN-10774: Attachment: YARN-10774.001.patch > Federation: Normalize the yarn federation queue name >

[jira] [Created] (YARN-10774) Federation: Normalize the yarn federation queue name

Yuan LUO created YARN-10774: --- Summary: Federation: Normalize the yarn federation queue name Key: YARN-10774 URL: https://issues.apache.org/jira/browse/YARN-10774 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-10111) In Federation cluster Distributed Shell Application submission fails as YarnClient#getQueueInfo is not implemented

[ https://issues.apache.org/jira/browse/YARN-10111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346094#comment-17346094 ] Yuan LUO commented on YARN-10111: - Hi [~zhuqi] Is there any new discussion progress on this patch？ I have

[jira] [Comment Edited] (YARN-10465) Support getClusterNodes, getNodeToLabels, getLabelsToNodes, getClusterNodeLabels API's for Federation

[ https://issues.apache.org/jira/browse/YARN-10465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346090#comment-17346090 ] Yuan LUO edited comment on YARN-10465 at 5/17/21, 11:21 AM: Hi [~ayushsaxena]

[jira] [Commented] (YARN-10465) Support getClusterNodes, getNodeToLabels, getLabelsToNodes, getClusterNodeLabels API's for Federation

[ https://issues.apache.org/jira/browse/YARN-10465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346090#comment-17346090 ] Yuan LUO commented on YARN-10465: - Hi [~ayushsaxena] [~tangzhankun] [~zhuqi]] Can you help review

[jira] [Commented] (YARN-10487) Support getQueueUserAcls, listReservations, getApplicationAttempts, getContainerReport, getContainers, getResourceTypeInfo API's for Federation

[ https://issues.apache.org/jira/browse/YARN-10487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346079#comment-17346079 ] Yuan LUO commented on YARN-10487: - Hi [~dmmkr] I don't think it's necessary for these APIs to request

[jira] [Commented] (YARN-8173) [Router] Implement missing FederationClientInterceptor#getApplications()

[ https://issues.apache.org/jira/browse/YARN-8173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17346073#comment-17346073 ] Yuan LUO commented on YARN-8173: Hi [~dmmkr] [~giovanni.fumarola] We want use Livy to run in YARN