[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844506#comment-16844506 ] Tan, Wangda commented on YARN-9567: --- This looks great! Huge thanks to [~Tao Yang] for pushing it! How

[jira] [Commented] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844496#comment-16844496 ] Tan, Wangda commented on YARN-4946: --- Thanks [~ccondit],  I'm not entirely convinced that fix of this

[jira] [Commented] (YARN-9571) RM state store purging should be configurable if log aggregation does not terminate

[ https://issues.apache.org/jira/browse/YARN-9571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1687#comment-1687 ] Hadoop QA commented on YARN-9571: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844394#comment-16844394 ] Craig Condit commented on YARN-4946: Opened YARN-9571 to make this feature configurable. I think with

[jira] [Commented] (YARN-9012) NPE in scheduler UI when min-capacity is not configured

[ https://issues.apache.org/jira/browse/YARN-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844389#comment-16844389 ] Craig Condit commented on YARN-9012: [~sunilg] Can you review this? > NPE in scheduler UI when

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844355#comment-16844355 ] Hadoop QA commented on YARN-9560: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9571) RM state store purging should be configurable if log aggregation does not terminate

[ https://issues.apache.org/jira/browse/YARN-9571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Condit updated YARN-9571: --- Description: YARN-4946 introduced logic which prevents applications from being removed from the RM

[jira] [Created] (YARN-9571) RM state store purging should be configurable if log aggregation does not terminate

Craig Condit created YARN-9571: -- Summary: RM state store purging should be configurable if log aggregation does not terminate Key: YARN-9571 URL: https://issues.apache.org/jira/browse/YARN-9571 Project:

[jira] [Updated] (YARN-9570) application in pending-ordering-policy is not considered while container allocation

[ https://issues.apache.org/jira/browse/YARN-9570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tan, Wangda updated YARN-9570: -- Summary: application in pending-ordering-policy is not considered while container allocation (was:

[jira] [Commented] (YARN-9543) UI2 should handle missing ATSv2 gracefully

[ https://issues.apache.org/jira/browse/YARN-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844309#comment-16844309 ] Tan, Wangda commented on YARN-9543: --- Cool, thanks [~giovanni.fumarola] :) > UI2 should handle missing

[jira] [Commented] (YARN-9561) Add C changes for the new OCI/squashfs/runc runtime

[ https://issues.apache.org/jira/browse/YARN-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844311#comment-16844311 ] Jim Brennan commented on YARN-9561: --- [~ebadger] thanks for the patch!  I did an extensive review of this

[jira] [Commented] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844308#comment-16844308 ] Tan, Wangda commented on YARN-4946: --- Thanks [~snemeth], [~ccondit] for commenting.  The question I was

[jira] [Created] (YARN-9570) pplication in pending-ordering-policy is not considered while container allocation

Yesha Vora created YARN-9570: Summary: pplication in pending-ordering-policy is not considered while container allocation Key: YARN-9570 URL: https://issues.apache.org/jira/browse/YARN-9570 Project:

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844282#comment-16844282 ] Eric Badger commented on YARN-9560: --- Thanks for the review, [~Jim_Brennan]! I uploaded patch 002 to

[jira] [Commented] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844279#comment-16844279 ] Craig Condit commented on YARN-4946: Backporting this as-is may not be a good idea. There is no

[jira] [Updated] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9560: -- Attachment: YARN-9560.002.patch > Restructure DockerLinuxContainerRuntime to extend a new

[jira] [Commented] (YARN-9543) UI2 should handle missing ATSv2 gracefully

[ https://issues.apache.org/jira/browse/YARN-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844252#comment-16844252 ] Giovanni Matteo Fumarola commented on YARN-9543: [~wangda], we do not have the same

[jira] [Updated] (YARN-9569) Auto-created leaf queues do not honor cluster-wide min/max memory/vcores

[ https://issues.apache.org/jira/browse/YARN-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Condit updated YARN-9569: --- Description: Auto-created leaf queues do not honor cluster-wide settings for maximum CPU/vcores

[jira] [Created] (YARN-9569) Auto-created leaf queues do not honor cluster-wide min/max memory/vcores

Craig Condit created YARN-9569: -- Summary: Auto-created leaf queues do not honor cluster-wide min/max memory/vcores Key: YARN-9569 URL: https://issues.apache.org/jira/browse/YARN-9569 Project: Hadoop

[jira] [Commented] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

[ https://issues.apache.org/jira/browse/YARN-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844227#comment-16844227 ] Steve Loughran commented on YARN-9568: -- Looking more at this looks like a bad assumption in the whole

[jira] [Commented] (YARN-7988) Refactor FSNodeLabelStore code for Node Attributes store support

[ https://issues.apache.org/jira/browse/YARN-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844226#comment-16844226 ] Steve Loughran commented on YARN-7988: -- Just traced down the cause of YARN-9568 to be ~this patch.

[jira] [Commented] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

[ https://issues.apache.org/jira/browse/YARN-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844223#comment-16844223 ] Steve Loughran commented on YARN-9568: -- I can make this "go away" by rm'ing everything in

[jira] [Updated] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

[ https://issues.apache.org/jira/browse/YARN-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-9568: - Priority: Minor (was: Major) > NPE in MiniYarnCluster during

[jira] [Commented] (YARN-9543) UI2 should handle missing ATSv2 gracefully

[ https://issues.apache.org/jira/browse/YARN-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844212#comment-16844212 ] Tan, Wangda commented on YARN-9543: --- [~giovanni.fumarola], do you have the same request internally? It

[jira] [Commented] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

[ https://issues.apache.org/jira/browse/YARN-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844201#comment-16844201 ] Steve Loughran commented on YARN-9568: -- attached full log > NPE in MiniYarnCluster during

[jira] [Updated] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

[ https://issues.apache.org/jira/browse/YARN-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-9568: - Attachment: npe.log > NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover >

[jira] [Commented] (YARN-9471) Cleanup in TestLogAggregationIndexFileController

[ https://issues.apache.org/jira/browse/YARN-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844160#comment-16844160 ] Hadoop QA commented on YARN-9471: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844149#comment-16844149 ] Hadoop QA commented on YARN-9525: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

[ https://issues.apache.org/jira/browse/YARN-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844138#comment-16844138 ] Steve Loughran commented on YARN-9568: -- {code}

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844133#comment-16844133 ] Tan, Wangda commented on YARN-9525: --- Thanks [~pbacsko]. > IFile format is not working against s3a

[jira] [Created] (YARN-9568) NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover

Steve Loughran created YARN-9568: Summary: NPE in MiniYarnCluster during FileSystemNodeAttributeStore.recover Key: YARN-9568 URL: https://issues.apache.org/jira/browse/YARN-9568 Project: Hadoop YARN

[jira] [Commented] (YARN-9560) Restructure DockerLinuxContainerRuntime to extend a new OCIContainerRuntime

[ https://issues.apache.org/jira/browse/YARN-9560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844121#comment-16844121 ] Jim Brennan commented on YARN-9560: --- [~ebadger] Thanks for the patch. Overall this looks like a good

[jira] [Commented] (YARN-9471) Cleanup in TestLogAggregationIndexFileController

[ https://issues.apache.org/jira/browse/YARN-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844115#comment-16844115 ] Adam Antal commented on YARN-9471: -- Oh, in the meantime YARN-9470 got committed. Rebased. Thanks for the

[jira] [Updated] (YARN-9471) Cleanup in TestLogAggregationIndexFileController

[ https://issues.apache.org/jira/browse/YARN-9471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9471: - Attachment: YARN-9471.002.patch > Cleanup in TestLogAggregationIndexFileController >

[jira] [Assigned] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko reassigned YARN-9525: -- Assignee: Peter Bacsko (was: Adam Antal) > IFile format is not working against s3a remote

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9525: --- Attachment: YARN-9525-001.patch > IFile format is not working against s3a remote folder >

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844097#comment-16844097 ] Tan, Wangda commented on YARN-9525: --- [~pbacsko], can you rename the patch to YARN-9525.001.poc.patch,

[jira] [Commented] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844083#comment-16844083 ] Peter Bacsko commented on YARN-9525: I uploaded a simple POC that seems to solve the issue on S3. >

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9525: --- Attachment: (was: IFile-S3A-POC01.patch) > IFile format is not working against s3a remote folder

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9525: --- Attachment: IFile-S3A-POC01.patch > IFile format is not working against s3a remote folder >

[jira] [Updated] (YARN-9525) IFile format is not working against s3a remote folder

[ https://issues.apache.org/jira/browse/YARN-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9525: --- Attachment: IFile-S3A-POC01.patch > IFile format is not working against s3a remote folder >

[jira] [Commented] (YARN-9546) Add configuration option for YARN Native services AM classpath

[ https://issues.apache.org/jira/browse/YARN-9546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844032#comment-16844032 ] Hudson commented on YARN-9546: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16574 (See

[jira] [Updated] (YARN-9546) Add configuration option for YARN Native services AM classpath

[ https://issues.apache.org/jira/browse/YARN-9546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-9546: - Summary: Add configuration option for YARN Native services AM classpath (was: Add configuration

[jira] [Commented] (YARN-9546) Add configuration option for yarn services AM classpath

[ https://issues.apache.org/jira/browse/YARN-9546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844017#comment-16844017 ] Sunil Govindan commented on YARN-9546: -- +1 on latest patch. Committing same. > Add configuration

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Description: Currently on app attempt page we can see outstanding resource requests, it will be helpful for

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: show_diagnostics_after_requesting_app_activities_REST_API.png > Add diagnostics for outstanding

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: (was: show_diagnostics_after_requesting_app_activities_REST_API.png) > Add diagnostics for

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Description: Currently on app attempt page we can see outstanding resource requests, it will be helpful for

[jira] [Created] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

Tao Yang created YARN-9567: -- Summary: Add diagnostics for outstanding resource requests on app attempts page Key: YARN-9567 URL: https://issues.apache.org/jira/browse/YARN-9567 Project: Hadoop YARN

[jira] [Commented] (YARN-9497) Support grouping by diagnostics for query results of scheduler and app activities

[ https://issues.apache.org/jira/browse/YARN-9497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843929#comment-16843929 ] Weiwei Yang commented on YARN-9497: --- Hi [~Tao Yang] {quote}perhaps we can take state dimension as

[jira] [Assigned] (YARN-8224) LogAggregation status TIME_OUT for absent container misleading

[ https://issues.apache.org/jira/browse/YARN-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph reassigned YARN-8224: --- Assignee: Szilard Nemeth (was: Prabhu Joseph) > LogAggregation status TIME_OUT for absent

[jira] [Commented] (YARN-8224) LogAggregation status TIME_OUT for absent container misleading

[ https://issues.apache.org/jira/browse/YARN-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843918#comment-16843918 ] Prabhu Joseph commented on YARN-8224: - Yes Sure [~snemeth], will assign it to you. > LogAggregation

[jira] [Commented] (YARN-8224) LogAggregation status TIME_OUT for absent container misleading

[ https://issues.apache.org/jira/browse/YARN-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843916#comment-16843916 ] Szilard Nemeth commented on YARN-8224: -- Thanks [~Prabhu Joseph]! Can I assign this one to myself?

[jira] [Created] (YARN-9566) TestWeightedRandomRouterPolicy fails intermittent

Prabhu Joseph created YARN-9566: --- Summary: TestWeightedRandomRouterPolicy fails intermittent Key: YARN-9566 URL: https://issues.apache.org/jira/browse/YARN-9566 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8224) LogAggregation status TIME_OUT for absent container misleading

[ https://issues.apache.org/jira/browse/YARN-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843874#comment-16843874 ] Prabhu Joseph commented on YARN-8224: - Yes right [~snemeth], Unit Test can help to reproduce the issue

[jira] [Commented] (YARN-8224) LogAggregation status TIME_OUT for absent container misleading

[ https://issues.apache.org/jira/browse/YARN-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843869#comment-16843869 ] Szilard Nemeth commented on YARN-8224: -- Hi [~Prabhu Joseph]! Thanks for summing it up! Based on your

[jira] [Comment Edited] (YARN-8224) LogAggregation status TIME_OUT for absent container misleading

[ https://issues.apache.org/jira/browse/YARN-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843863#comment-16843863 ] Prabhu Joseph edited comment on YARN-8224 at 5/20/19 11:01 AM: --- [~snemeth]

[jira] [Commented] (YARN-8224) LogAggregation status TIME_OUT for absent container misleading

[ https://issues.apache.org/jira/browse/YARN-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843863#comment-16843863 ] Prabhu Joseph commented on YARN-8224: - [~snemeth] Have missed to debug when the issue happened. But as

[jira] [Commented] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843846#comment-16843846 ] Szilard Nemeth commented on YARN-4946: -- Hi [~leftnoteasy]! As discussed offline, I don't really know

[jira] [Commented] (YARN-8224) LogAggregation status TIME_OUT for absent container misleading

[ https://issues.apache.org/jira/browse/YARN-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843842#comment-16843842 ] Szilard Nemeth commented on YARN-8224: -- Hi [~Prabhu Joseph]! Could you please elaborate how this

[jira] [Assigned] (YARN-9557) Application fails in diskchecker when ReadWriteDiskValidator is configured.

[ https://issues.apache.org/jira/browse/YARN-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T reassigned YARN-9557: --- Assignee: Bilwa S T > Application fails in diskchecker when ReadWriteDiskValidator is configured. >

[jira] [Created] (YARN-9565) RMAppImpl#ranNodes not cleared on FinalTransition

Bibin A Chundatt created YARN-9565: -- Summary: RMAppImpl#ranNodes not cleared on FinalTransition Key: YARN-9565 URL: https://issues.apache.org/jira/browse/YARN-9565 Project: Hadoop YARN