[jira] [Commented] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16716067#comment-16716067 ] Hadoop QA commented on YARN-9033: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9033: --- Attachment: YARN-9033-trunk.002.patch > ResourceHandlerChain#bootstrap is invoked twice during NM

[jira] [Commented] (YARN-9106) Add option to graceful decommission to not wait for applications

[ https://issues.apache.org/jira/browse/YARN-9106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715964#comment-16715964 ] Hadoop QA commented on YARN-9106: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9107) Jar validation bash scripts don't work on Windows due to platform differences (colons in paths, \r\n)

[ https://issues.apache.org/jira/browse/YARN-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715930#comment-16715930 ] Hadoop QA commented on YARN-9107: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9051) Integrate multiple CustomResourceTypesConfigurationProvider implementations into one

[ https://issues.apache.org/jira/browse/YARN-9051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715882#comment-16715882 ] Hadoop QA commented on YARN-9051: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9107) Jar validation bash scripts don't work on Windows due to platform differences (colons in paths, \r\n)

[ https://issues.apache.org/jira/browse/YARN-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Grunkemeyer updated YARN-9107: Description: Building Hadoop fails on Windows due to a few shell scripts that make invalid

[jira] [Updated] (YARN-9107) Jar validation bash scripts don't work on Windows due to platform differences (colons in paths, \r\n)

[ https://issues.apache.org/jira/browse/YARN-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Grunkemeyer updated YARN-9107: Summary: Jar validation bash scripts don't work on Windows due to platform differences

[jira] [Updated] (YARN-9107) Bash scripts don't work on Windows due to platform differences (colons in paths, \r\n)

[ https://issues.apache.org/jira/browse/YARN-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Grunkemeyer updated YARN-9107: Attachment: YARN-9107.v1.patch > Bash scripts don't work on Windows due to platform

[jira] [Created] (YARN-9107) Bash scripts don't work on Windows due to platform differences (colons in paths, \r\n)

Brian Grunkemeyer created YARN-9107: --- Summary: Bash scripts don't work on Windows due to platform differences (colons in paths, \r\n) Key: YARN-9107 URL: https://issues.apache.org/jira/browse/YARN-9107

[jira] [Commented] (YARN-9089) Add Terminal Link to Service component instance page for UI2

[ https://issues.apache.org/jira/browse/YARN-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715796#comment-16715796 ] Eric Yang commented on YARN-9089: - [~akhilpb] Thank you for the review.  Agree that models are not meant

[jira] [Commented] (YARN-9084) Service Upgrade: With default readiness check, the status of upgrade is reported to be successful prematurely

[ https://issues.apache.org/jira/browse/YARN-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715702#comment-16715702 ] Hadoop QA commented on YARN-9084: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-9106) Add option to graceful decommission to not wait for applications

Mikayla Konst created YARN-9106: --- Summary: Add option to graceful decommission to not wait for applications Key: YARN-9106 URL: https://issues.apache.org/jira/browse/YARN-9106 Project: Hadoop YARN

[jira] [Commented] (YARN-9075) Dynamically add or remove auxiliary services

[ https://issues.apache.org/jira/browse/YARN-9075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715607#comment-16715607 ] Hadoop QA commented on YARN-9075: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9084) Service Upgrade: With default readiness check, the status of upgrade is reported to be successful prematurely

[ https://issues.apache.org/jira/browse/YARN-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-9084: Attachment: YARN-9084.001.patch > Service Upgrade: With default readiness check, the status of

[jira] [Updated] (YARN-9084) Service Upgrade: With default readiness check, the status of upgrade is reported to be successful prematurely

[ https://issues.apache.org/jira/browse/YARN-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-9084: Attachment: (was: YARN-9084.001.patch) > Service Upgrade: With default readiness check, the

[jira] [Updated] (YARN-9084) Service Upgrade: With default readiness check, the status of upgrade is reported to be successful prematurely

[ https://issues.apache.org/jira/browse/YARN-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-9084: Attachment: YARN-9084.001.patch > Service Upgrade: With default readiness check, the status of

[jira] [Updated] (YARN-9084) Service Upgrade: With default readiness check, the status of upgrade is reported to be successful prematurely

[ https://issues.apache.org/jira/browse/YARN-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-9084: Attachment: (was: YARN-9084.001.patch) > Service Upgrade: With default readiness check, the

[jira] [Updated] (YARN-9084) Service Upgrade: With default readiness check, the status of upgrade is reported to be successful prematurely

[ https://issues.apache.org/jira/browse/YARN-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-9084: Attachment: YARN-9084.001.patch > Service Upgrade: With default readiness check, the status of

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715563#comment-16715563 ] Hadoop QA commented on YARN-6523: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715476#comment-16715476 ] Hadoop QA commented on YARN-9060: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9087) Improve logging for initialization of Resource plugins

[ https://issues.apache.org/jira/browse/YARN-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715463#comment-16715463 ] Hudson commented on YARN-9087: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15582 (See

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715459#comment-16715459 ] Haibo Chen commented on YARN-9008: -- {quote}I took that from {{Client.java}}, where it's also called

[jira] [Updated] (YARN-9075) Dynamically add or remove auxiliary services

[ https://issues.apache.org/jira/browse/YARN-9075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-9075: - Attachment: YARN-9075.003.patch > Dynamically add or remove auxiliary services >

[jira] [Commented] (YARN-8738) FairScheduler should not parse negative maxResources or minResources values as positive

[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715424#comment-16715424 ] Hudson commented on YARN-8738: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15581 (See

[jira] [Updated] (YARN-9087) Improve logging for initialization of Resource plugins

[ https://issues.apache.org/jira/browse/YARN-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-9087: - Fix Version/s: 3.3.0 > Improve logging for initialization of Resource plugins >

[jira] [Commented] (YARN-9087) Better logging for initialization of Resource plugins

[ https://issues.apache.org/jira/browse/YARN-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715401#comment-16715401 ] Haibo Chen commented on YARN-9087: -- +1 on the latest patch. > Better logging for initialization of

[jira] [Updated] (YARN-9087) Improve logging for initialization of Resource plugins

[ https://issues.apache.org/jira/browse/YARN-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-9087: - Summary: Improve logging for initialization of Resource plugins (was: Better logging for initialization

[jira] [Commented] (YARN-8738) FairScheduler configures maxResources or minResources as negative, the value parse to a positive number.

[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715375#comment-16715375 ] Haibo Chen commented on YARN-8738: -- +1 on the latest patch. Checking it in shortly. > FairScheduler

[jira] [Updated] (YARN-8738) FairScheduler should not parse negative maxResources or minResources values as positive

[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8738: - Summary: FairScheduler should not parse negative maxResources or minResources values as positive (was:

[jira] [Commented] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715350#comment-16715350 ] Hadoop QA commented on YARN-9033: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9084) Service Upgrade: With default readiness check, the status of upgrade is reported to be successful prematurely

[ https://issues.apache.org/jira/browse/YARN-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-9084: Description: With YARN-9071 we do clear the IP address and Hostname from AM, NM and yarn registry

[jira] [Updated] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9033: --- Attachment: YARN-9033-trunk.001.patch > ResourceHandlerChain#bootstrap is invoked twice during NM

[jira] [Updated] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9033: --- Description: The ResourceHandlerChain#bootstrap will always be invoked in NM's

[jira] [Updated] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6523: --- Attachment: YARN-6523.011.patch > Newly retrieved security Tokens are sent as part of each heartbeat

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715170#comment-16715170 ] Manikandan R commented on YARN-6523: Addressed checkstyle and javadoc issues except 1 issue. Couldn't

[jira] [Commented] (YARN-7746) Fix PlacementProcessor to support app priority

[ https://issues.apache.org/jira/browse/YARN-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16715147#comment-16715147 ] Manikandan R commented on YARN-7746: Ok [~cheersyang]. Thanks. Can we define new property and use it

[jira] [Updated] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9033: --- Description: The ResourceHandlerChain#bootstrap will always be invoked in NM's

[jira] [Updated] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9033: --- Description: The ResourceHandlerChain#bootstrap will always be invoked in NM's

[jira] [Updated] (YARN-9033) ResourceHandlerChain#bootstrap is invoked twice during NM start if LinuxContainerExecutor enabled

[ https://issues.apache.org/jira/browse/YARN-9033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9033: --- Description: The ResourceHandlerChain#bootstrap will always be invoked in NM's

[jira] [Updated] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9060: --- Attachment: YARN-9060-trunk.005.patch > [YARN-8851] Phase 1 - Support device isolation in native

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714921#comment-16714921 ] Hadoop QA commented on YARN-9008: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9037) [CSI] Ignore volume resource in resource calculators based on tags

[ https://issues.apache.org/jira/browse/YARN-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714914#comment-16714914 ] Weiwei Yang commented on YARN-9037: --- Hi [~sunilg] Latest patch looks good to me, I'll do some testing

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714809#comment-16714809 ] Peter Bacsko commented on YARN-9008: I uploaded patch v5 in the meantime. > Extend YARN distributed

[jira] [Updated] (YARN-9008) Extend YARN distributed shell with file localization feature

[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9008: --- Attachment: YARN-9008-005.patch > Extend YARN distributed shell with file localization feature >

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714776#comment-16714776 ] Peter Bacsko commented on YARN-9008: {quote}We are missing one unit test for upload a non-existent

[jira] [Updated] (YARN-9008) Extend YARN distributed shell with file localization feature

[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9008: --- Affects Version/s: (was: 2.9.1) > Extend YARN distributed shell with file localization feature >

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714729#comment-16714729 ] Hadoop QA commented on YARN-9060: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8617) Aggregated Application Logs accumulates for long running jobs

[ https://issues.apache.org/jira/browse/YARN-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714696#comment-16714696 ] Bibin A Chundatt commented on YARN-8617: [~Prabhu Joseph] Looked into the issue again ..YARN-2583

[jira] [Commented] (YARN-9037) [CSI] Ignore volume resource in resource calculators based on tags

[ https://issues.apache.org/jira/browse/YARN-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714652#comment-16714652 ] Hadoop QA commented on YARN-9037: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9105) [UI2] Application master container resource information should be displayed in UI2

[ https://issues.apache.org/jira/browse/YARN-9105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-9105: --- Component/s: yarn-ui-v2 > [UI2] Application master container resource information should be displayed > in

[jira] [Created] (YARN-9105) [UI2] Application master container resource information should be displayed in UI2

Akhil PB created YARN-9105: -- Summary: [UI2] Application master container resource information should be displayed in UI2 Key: YARN-9105 URL: https://issues.apache.org/jira/browse/YARN-9105 Project: Hadoop

[jira] [Commented] (YARN-9099) GpuResourceAllocator.getReleasingGpus calculates number of GPUs in a wrong way

[ https://issues.apache.org/jira/browse/YARN-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714573#comment-16714573 ] Hadoop QA commented on YARN-9099: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-9104) Fix the bug in DeviceMappingManager#getReleasingDevices

[ https://issues.apache.org/jira/browse/YARN-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved YARN-9104. Resolution: Duplicate Resolve this due to JIRA's duplicated the creation > Fix the bug in

[jira] [Created] (YARN-9103) Fix the bug in DeviceMappingManager#getReleasingDevices

Zhankun Tang created YARN-9103: -- Summary: Fix the bug in DeviceMappingManager#getReleasingDevices Key: YARN-9103 URL: https://issues.apache.org/jira/browse/YARN-9103 Project: Hadoop YARN Issue

[jira] [Created] (YARN-9104) Fix the bug in DeviceMappingManager#getReleasingDevices

Zhankun Tang created YARN-9104: -- Summary: Fix the bug in DeviceMappingManager#getReleasingDevices Key: YARN-9104 URL: https://issues.apache.org/jira/browse/YARN-9104 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-9102) Log Aggregation is failing with S3A FileSystem for IFile Format

[ https://issues.apache.org/jira/browse/YARN-9102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] VAMSHI KRISHNA updated YARN-9102: - Summary: Log Aggregation is failing with S3A FileSystem for IFile Format (was: Log Aggregation

[jira] [Created] (YARN-9102) Log Aggregation is failing with S3A/OBS FileSystem for IFile Format

VAMSHI KRISHNA created YARN-9102: Summary: Log Aggregation is failing with S3A/OBS FileSystem for IFile Format Key: YARN-9102 URL: https://issues.apache.org/jira/browse/YARN-9102 Project: Hadoop YARN

[jira] [Commented] (YARN-9099) GpuResourceAllocator.getReleasingGpus calculates number of GPUs in a wrong way

[ https://issues.apache.org/jira/browse/YARN-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714513#comment-16714513 ] Zhankun Tang commented on YARN-9099: [~snemeth], Thanks for catching up this! The patch looks good to

[jira] [Updated] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9060: --- Attachment: YARN-9060-trunk.004.patch > [YARN-8851] Phase 1 - Support device isolation in native

[jira] [Commented] (YARN-9037) [CSI] Ignore volume resource in resource calculators based on tags

[ https://issues.apache.org/jira/browse/YARN-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714449#comment-16714449 ] Sunil Govindan commented on YARN-9037: -- Ideally we let all creation of resources to have any types of

[jira] [Commented] (YARN-9037) [CSI] Ignore volume resource in resource calculators based on tags

[ https://issues.apache.org/jira/browse/YARN-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714450#comment-16714450 ] Sunil Govindan commented on YARN-9037: -- [~cheersyang] cud u pls check > [CSI] Ignore volume resource

[jira] [Updated] (YARN-9037) [CSI] Ignore volume resource in resource calculators based on tags

[ https://issues.apache.org/jira/browse/YARN-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-9037: - Attachment: YARN-9037.003.patch > [CSI] Ignore volume resource in resource calculators based on

[jira] [Commented] (YARN-7715) Support NM promotion/demotion of running containers.

[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16714443#comment-16714443 ] Zhankun Tang commented on YARN-7715: [~miklos.szeg...@cloudera.com], [~asuresh], Is this JIRA depend