[jira] [Updated] (YARN-9038) Add ability to publish/unpublish volumes on node managers

[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9038: -- Attachment: YARN-9038.001.patch > Add ability to publish/unpublish volumes on node managers >

[jira] [Updated] (YARN-9038) Add ability to publish/unpublish volumes on node managers

[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9038: -- Summary: Add ability to publish/unpublish volumes on node managers (was: Add ability to publish

[jira] [Updated] (YARN-8940) [CSI] Add volume as a top-level attribute in service spec

[ https://issues.apache.org/jira/browse/YARN-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8940: -- Summary: [CSI] Add volume as a top-level attribute in service spec (was: Add volume as a top-level

[jira] [Created] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

Weiwei Yang created YARN-9086: - Summary: [CSI] Run csi-driver-adaptor as aux service Key: YARN-9086 URL: https://issues.apache.org/jira/browse/YARN-9086 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711322#comment-16711322 ] Hadoop QA commented on YARN-9038: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8822) Nvidia-docker v2 support

[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charo Zhang updated YARN-8822: -- Attachment: YARN-8822.003.patch > Nvidia-docker v2 support > > >

[jira] [Updated] (YARN-9057) [CSI] CSI jar file should not bundle third party dependencies

[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9057: -- Summary: [CSI] CSI jar file should not bundle third party dependencies (was: CSI jar file should not

[jira] [Commented] (YARN-9051) Integrate multiple CustomResourceTypesConfigurationProvider implementations into one

[ https://issues.apache.org/jira/browse/YARN-9051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711908#comment-16711908 ] Szilard Nemeth commented on YARN-9051: -- Thanks [~haibochen] for your review! Fixed all the points

[jira] [Updated] (YARN-9051) Integrate multiple CustomResourceTypesConfigurationProvider implementations into one

[ https://issues.apache.org/jira/browse/YARN-9051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9051: - Attachment: YARN-9051.002.patch > Integrate multiple CustomResourceTypesConfigurationProvider

[jira] [Commented] (YARN-8738) FairScheduler configures maxResources or minResources as negative, the value parse to a positive number.

[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712039#comment-16712039 ] Haibo Chen commented on YARN-8738: -- Thanks [~snemeth] for the elaboration. What I meant is that because

[jira] [Updated] (YARN-9085) Guaranteed and MaxCapacity CSQueueMetrics

[ https://issues.apache.org/jira/browse/YARN-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9085: Attachment: YARN-9085.002.patch > Guaranteed and MaxCapacity CSQueueMetrics >

[jira] [Commented] (YARN-9035) Allow better troubleshooting of FS container assignments and lack of container assignments

[ https://issues.apache.org/jira/browse/YARN-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711943#comment-16711943 ] Haibo Chen commented on YARN-9035: -- Thanks [~snemeth] for the patch. This would be very helpful when it

[jira] [Created] (YARN-9088) Non-exclusive labels break QueueMetrics

Brandon Scheller created YARN-9088: -- Summary: Non-exclusive labels break QueueMetrics Key: YARN-9088 URL: https://issues.apache.org/jira/browse/YARN-9088 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8738) FairScheduler configures maxResources or minResources as negative, the value parse to a positive number.

[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711940#comment-16711940 ] Szilard Nemeth commented on YARN-8738: -- Thanks [~haibochen] for your comments! The reason why I

[jira] [Commented] (YARN-9035) Allow better troubleshooting of FS container assignments and lack of container assignments

[ https://issues.apache.org/jira/browse/YARN-9035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711944#comment-16711944 ] Haibo Chen commented on YARN-9035: -- [~wilfreds] probably has a much better idea of what is preferred from

[jira] [Commented] (YARN-9075) Dynamically add or remove auxiliary services

[ https://issues.apache.org/jira/browse/YARN-9075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712016#comment-16712016 ] Hadoop QA commented on YARN-9075: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9088) Non-exclusive labels break QueueMetrics

[ https://issues.apache.org/jira/browse/YARN-9088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Scheller updated YARN-9088: --- Description: QueueMetrics are broken (random/negative values) when non-exclusive labels are

[jira] [Created] (YARN-9089) Add Terminal Link to Service component instance page for UI2

Eric Yang created YARN-9089: --- Summary: Add Terminal Link to Service component instance page for UI2 Key: YARN-9089 URL: https://issues.apache.org/jira/browse/YARN-9089 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-9085) Guaranteed and MaxCapacity CSQueueMetrics

[ https://issues.apache.org/jira/browse/YARN-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712055#comment-16712055 ] Jonathan Hung commented on YARN-9085: - Thanks folks. Upon reviewing your comments I feel this logic is

[jira] [Commented] (YARN-9087) Better logging for initialization of Resource plugins

[ https://issues.apache.org/jira/browse/YARN-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712108#comment-16712108 ] Haibo Chen commented on YARN-9087: -- Thanks [~snemeth] for the patch. A few nits about the patch. 1) Not

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712110#comment-16712110 ] Eric Yang commented on YARN-8914: - While developing for Service > Components > Component Instance view, I

[jira] [Commented] (YARN-9085) Guaranteed and MaxCapacity CSQueueMetrics

[ https://issues.apache.org/jira/browse/YARN-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712163#comment-16712163 ] Hadoop QA commented on YARN-9085: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9008) Extend YARN distributed shell with file localization feature

[ https://issues.apache.org/jira/browse/YARN-9008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712143#comment-16712143 ] Haibo Chen commented on YARN-9008: -- Thanks [~pbacsko] for the patch!  A few minor comments 1) We are

[jira] [Updated] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9038: -- Labels: CSI (was: ) > [CSI] Add ability to publish/unpublish volumes on node managers >

[jira] [Updated] (YARN-8873) [YARN-8811] Add CSI java-based client library

[ https://issues.apache.org/jira/browse/YARN-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8873: -- Labels: CSI (was: ) > [YARN-8811] Add CSI java-based client library >

[jira] [Updated] (YARN-8811) Support Container Storage Interface (CSI) in YARN

[ https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8811: -- Labels: CSI (was: ) > Support Container Storage Interface (CSI) in YARN >

[jira] [Updated] (YARN-9038) [CSI] Add ability to publish/unpublish volumes on node managers

[ https://issues.apache.org/jira/browse/YARN-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9038: -- Summary: [CSI] Add ability to publish/unpublish volumes on node managers (was: Add ability to

[jira] [Updated] (YARN-9058) [CSI] YARN service fail to launch due to CSI changes

[ https://issues.apache.org/jira/browse/YARN-9058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9058: -- Labels: CSI (was: ) > [CSI] YARN service fail to launch due to CSI changes >

[jira] [Updated] (YARN-8953) [CSI] CSI driver adaptor module support in NodeManager

[ https://issues.apache.org/jira/browse/YARN-8953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8953: -- Labels: CSI (was: ) > [CSI] CSI driver adaptor module support in NodeManager >

[jira] [Updated] (YARN-9037) [CSI] Ignore volume resource in resource calculators based on tags

[ https://issues.apache.org/jira/browse/YARN-9037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9037: -- Labels: CSI (was: ) > [CSI] Ignore volume resource in resource calculators based on tags >

[jira] [Updated] (YARN-8877) [CSI] Extend service spec to allow setting resource attributes

[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8877: -- Labels: CSI (was: ) > [CSI] Extend service spec to allow setting resource attributes >

[jira] [Updated] (YARN-8940) [CSI] Add volume as a top-level attribute in service spec

[ https://issues.apache.org/jira/browse/YARN-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8940: -- Labels: CSI (was: ) > [CSI] Add volume as a top-level attribute in service spec >

[jira] [Updated] (YARN-9057) CSI jar file should not bundle third party dependencies

[ https://issues.apache.org/jira/browse/YARN-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9057: -- Labels: CSI (was: ) > CSI jar file should not bundle third party dependencies >

[jira] [Updated] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

[ https://issues.apache.org/jira/browse/YARN-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9086: -- Labels: CSI (was: ) > [CSI] Run csi-driver-adaptor as aux service >

[jira] [Updated] (YARN-8902) [CSI] Add volume manager that manages CSI volume lifecycle

[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8902: -- Labels: CSI (was: ) > [CSI] Add volume manager that manages CSI volume lifecycle >

[jira] [Commented] (YARN-8822) Nvidia-docker v2 support

[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711601#comment-16711601 ] Hadoop QA commented on YARN-8822: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9089) Add Terminal Link to Service component instance page for UI2

[ https://issues.apache.org/jira/browse/YARN-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9089: Attachment: YARN-9089.001.patch > Add Terminal Link to Service component instance page for UI2 >

[jira] [Commented] (YARN-9089) Add Terminal Link to Service component instance page for UI2

[ https://issues.apache.org/jira/browse/YARN-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712191#comment-16712191 ] Eric Yang commented on YARN-9089: - I was able to find a shorter workaround without refactoring data that

[jira] [Assigned] (YARN-9089) Add Terminal Link to Service component instance page for UI2

[ https://issues.apache.org/jira/browse/YARN-9089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-9089: --- Assignee: Eric Yang > Add Terminal Link to Service component instance page for UI2 >

[jira] [Commented] (YARN-8822) Nvidia-docker v2 support

[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712247#comment-16712247 ] Charo Zhang commented on YARN-8822: --- [~leftnoteasy] According to your suggestions, i updated 003 patch:

[jira] [Updated] (YARN-8822) Nvidia-docker v2 support

[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charo Zhang updated YARN-8822: -- Attachment: YARN-8822.004.patch > Nvidia-docker v2 support > > >

[jira] [Commented] (YARN-9051) Integrate multiple CustomResourceTypesConfigurationProvider implementations into one

[ https://issues.apache.org/jira/browse/YARN-9051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712229#comment-16712229 ] Hadoop QA commented on YARN-9051: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8822) Nvidia-docker v2 support

[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712247#comment-16712247 ] Charo Zhang edited comment on YARN-8822 at 12/7/18 2:09 AM: [~leftnoteasy]

[jira] [Assigned] (YARN-9022) MiniYarnCluster 3.1.0 RESTAPI not working for some cases

[ https://issues.apache.org/jira/browse/YARN-9022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9022: Assignee: Szilard Nemeth > MiniYarnCluster 3.1.0 RESTAPI not working for some cases >

[jira] [Commented] (YARN-8822) Nvidia-docker v2 support

[ https://issues.apache.org/jira/browse/YARN-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712390#comment-16712390 ] Hadoop QA commented on YARN-8822: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712361#comment-16712361 ] Akhil PB commented on YARN-8914: [~eyang]  Please use the UI2 changes from patch 9. I have made it a bit

[jira] [Updated] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8714: --- Attachment: YARN-8714-trunk.006.patch > [Submarine] Support files/tarballs to be localized for a

[jira] [Assigned] (YARN-9081) Update jackson from 1.9.13 to 2.x in hadoop-yarn-services-core

[ https://issues.apache.org/jira/browse/YARN-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned YARN-9081: --- Assignee: Akira Ajisaka > Update jackson from 1.9.13 to 2.x in hadoop-yarn-services-core >

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712411#comment-16712411 ] Hadoop QA commented on YARN-8714: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-9087) Better logging for initialization of Resource plugins

Szilard Nemeth created YARN-9087: Summary: Better logging for initialization of Resource plugins Key: YARN-9087 URL: https://issues.apache.org/jira/browse/YARN-9087 Project: Hadoop YARN

[jira] [Updated] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8714: --- Attachment: YARN-8714-trunk.005.patch > [Submarine] Support files/tarballs to be localized for a

[jira] [Updated] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8714: --- Attachment: YARN-8714-trunk.007.patch > [Submarine] Support files/tarballs to be localized for a

[jira] [Updated] (YARN-9081) Update jackson from 1.9.13 to 2.x in hadoop-yarn-services-core

[ https://issues.apache.org/jira/browse/YARN-9081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-9081: Attachment: YARN-9081.01.patch > Update jackson from 1.9.13 to 2.x in hadoop-yarn-services-core >

[jira] [Updated] (YARN-9075) Dynamically add or remove auxiliary services

[ https://issues.apache.org/jira/browse/YARN-9075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-9075: - Attachment: YARN-9075.001.patch > Dynamically add or remove auxiliary services >

[jira] [Commented] (YARN-9087) Better logging for initialization of Resource plugins

[ https://issues.apache.org/jira/browse/YARN-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711817#comment-16711817 ] Hadoop QA commented on YARN-9087: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-9087) Better logging for initialization of Resource plugins

[ https://issues.apache.org/jira/browse/YARN-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711712#comment-16711712 ] Szilard Nemeth edited comment on YARN-9087 at 12/6/18 5:11 PM: --- Most

[jira] [Updated] (YARN-9087) Better logging for initialization of Resource plugins

[ https://issues.apache.org/jira/browse/YARN-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9087: - Attachment: YARN-9087.001.patch > Better logging for initialization of Resource plugins >

[jira] [Commented] (YARN-9085) Guaranteed and MaxCapacity CSQueueMetrics

[ https://issues.apache.org/jira/browse/YARN-9085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711709#comment-16711709 ] Anthony Hsu commented on YARN-9085: --- Looks good overall. A few questions/comments: * In 

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711711#comment-16711711 ] Hadoop QA commented on YARN-8714: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9087) Better logging for initialization of Resource plugins

[ https://issues.apache.org/jira/browse/YARN-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711712#comment-16711712 ] Szilard Nemeth commented on YARN-9087: -- Most probably I will file some more jiras around GPU support

[jira] [Updated] (YARN-9022) MiniYarnCluster 3.1.0 RESTAPI not working for some cases

[ https://issues.apache.org/jira/browse/YARN-9022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9022: - Description: Actually I am not sure Should I open this Jira in Hadoop or in Spark projects. Try

[jira] [Commented] (YARN-9087) Better logging for initialization of Resource plugins

[ https://issues.apache.org/jira/browse/YARN-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711837#comment-16711837 ] Wangda Tan commented on YARN-9087: -- [~snemeth], Device plugin framework is for the future plugins. We