[jira] [Created] (YARN-8915) Update "maximum-container-assignments" default value in CapacityScheduler.md

2018-10-18 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8915: -- Summary: Update "maximum-container-assignments" default value in CapacityScheduler.md Key: YARN-8915 URL: https://issues.apache.org/jira/browse/YARN-8915 Project: Hadoop

[jira] [Updated] (YARN-8907) Modify a logging message in TestCapacityScheduler

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8907: --- Summary: Modify a logging message in TestCapacityScheduler (was: Modify a logging error message in

[jira] [Updated] (YARN-8907) Modify a logging error message in TestCapacityScheduler

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8907: --- Summary: Modify a logging error message in TestCapacityScheduler (was: Modify an logging error

[jira] [Updated] (YARN-8907) Modify an logging error message in TestCapacityScheduler

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8907: --- Summary: Modify an logging error message in TestCapacityScheduler (was: Modify an error message in

[jira] [Commented] (YARN-8908) Fix errors in yarn-default.xml related to GPU/FPGA

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656154#comment-16656154 ] Zhankun Tang commented on YARN-8908: [~leftnoteasy] / [~cheersyang] , Thanks for the review. Merge

[jira] [Updated] (YARN-8908) Fix errors in yarn-default.xml related to GPU/FPGA

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8908: --- Attachment: YARN-8908-trunk.002.patch > Fix errors in yarn-default.xml related to GPU/FPGA >

[jira] [Updated] (YARN-8907) Modify an error message in TestCapacityScheduler

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8907: --- Issue Type: Test (was: Bug) > Modify an error message in TestCapacityScheduler >

[jira] [Updated] (YARN-8907) Modify an error message in TestCapacityScheduler

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8907: --- Summary: Modify an error message in TestCapacityScheduler (was: Fix a error message in

[jira] [Assigned] (YARN-8908) Fix errors in yarn-default.xml related to GPU/FPGA

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang reassigned YARN-8908: -- Assignee: Zhankun Tang [~leftnoteasy] . Fix errors in document, please review. > Fix errors

[jira] [Updated] (YARN-8908) Fix errors in yarn-default.xml related to GPU/FPGA

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8908: --- Attachment: YARN-8908-trunk.001.patch > Fix errors in yarn-default.xml related to GPU/FPGA >

[jira] [Updated] (YARN-8909) Fix a document error in UsingFPGA.md

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8909: --- Attachment: YARN-8909-trunk.001.patch > Fix a document error in UsingFPGA.md >

[jira] [Assigned] (YARN-8909) Fix a document error in UsingFPGA.md

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang reassigned YARN-8909: -- Assignee: Zhankun Tang > Fix a document error in UsingFPGA.md >

[jira] [Created] (YARN-8909) Fix a document error in UsingFPGA.md

2018-10-18 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8909: -- Summary: Fix a document error in UsingFPGA.md Key: YARN-8909 URL: https://issues.apache.org/jira/browse/YARN-8909 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-8456) Fix a configuration handling bug when user leave FPGA discover executable path configuration default but set OpenCL SDK path environment variable

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8456: --- Attachment: YARN-8456-trunk.002.patch > Fix a configuration handling bug when user leave FPGA

[jira] [Updated] (YARN-8456) Fix a configuration handling bug when user leave FPGA discover executable path configuration default but set OpenCL SDK path environment variable

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8456: --- Description: *Issue:* When the user doesn't configure

[jira] [Updated] (YARN-8908) Fix errors in yarn-default.xml related to GPU/FPGA

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8908: --- Summary: Fix errors in yarn-default.xml related to GPU/FPGA (was: Fix errors in document of

[jira] [Created] (YARN-8908) Fix errors in document of GPU/FPGA

2018-10-18 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8908: -- Summary: Fix errors in document of GPU/FPGA Key: YARN-8908 URL: https://issues.apache.org/jira/browse/YARN-8908 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-8907) Modify a error message in TestCapacityScheduler

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16655500#comment-16655500 ] Zhankun Tang commented on YARN-8907: [~cheersyang] , Please review. Thanks. > Modify a error message

[jira] [Updated] (YARN-8907) Modify a error message in TestCapacityScheduler

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8907: --- Attachment: YARN-8907-trunk.001.patch > Modify a error message in TestCapacityScheduler >

[jira] [Created] (YARN-8907) Modify a error message in TestCapacityScheduler

2018-10-18 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8907: -- Summary: Modify a error message in TestCapacityScheduler Key: YARN-8907 URL: https://issues.apache.org/jira/browse/YARN-8907 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8896) Limit the maximum number of container assignments per heartbeat

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16655478#comment-16655478 ] Zhankun Tang commented on YARN-8896: [~leftnoteasy] , change the default max assign value from -1 to

[jira] [Updated] (YARN-8896) Limit the maximum number of container assignments per heartbeat

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8896: --- Attachment: YARN-8896-trunk.001.patch > Limit the maximum number of container assignments per

[jira] [Updated] (YARN-8881) Add basic pluggable device plugin framework

2018-10-18 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8881: --- Attachment: YARN-8881-trunk.001.patch > Add basic pluggable device plugin framework >

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654594#comment-16654594 ] Zhankun Tang edited comment on YARN-8851 at 10/18/18 3:59 AM: -- [~leftnoteasy]

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654594#comment-16654594 ] Zhankun Tang edited comment on YARN-8851 at 10/18/18 3:56 AM: -- [~leftnoteasy]

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654594#comment-16654594 ] Zhankun Tang edited comment on YARN-8851 at 10/18/18 3:52 AM: -- [~leftnoteasy]

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654557#comment-16654557 ] Zhankun Tang edited comment on YARN-8851 at 10/18/18 3:48 AM: -- [~leftnoteasy] 

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654594#comment-16654594 ] Zhankun Tang commented on YARN-8851: [~leftnoteasy] , For question 6, I'll try to answer here and we

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654557#comment-16654557 ] Zhankun Tang commented on YARN-8851: [~leftnoteasy]  5) DeviceRuntimeSpec is empty, what you plan to

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654534#comment-16654534 ] Zhankun Tang edited comment on YARN-8851 at 10/18/18 2:34 AM: -- [~leftnoteasy]

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654534#comment-16654534 ] Zhankun Tang edited comment on YARN-8851 at 10/18/18 2:22 AM: -- [~leftnoteasy]

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654534#comment-16654534 ] Zhankun Tang commented on YARN-8851: [~leftnoteasy] Thanks for the review! Very helpful comments! 1. 

[jira] [Comment Edited] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654534#comment-16654534 ] Zhankun Tang edited comment on YARN-8851 at 10/18/18 2:21 AM: -- [~leftnoteasy]

[jira] [Updated] (YARN-8881) Add basic pluggable device plugin framework

2018-10-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8881: --- Description: It includes adding support in "ResourcePluginManager" to load plugin classes based on

[jira] [Updated] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8880: --- Attachment: YARN-8880-trunk.002.patch > Add configurations for pluggable plugin framework >

[jira] [Updated] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8798: --- Attachment: YARN-8798-trunk.002.patch > [Submarine] Job should not be submitted if "--input_path"

[jira] [Commented] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651815#comment-16651815 ] Zhankun Tang commented on YARN-8798: [~sunilg] The failed test case is related to Tensorboard. Let's

[jira] [Commented] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651797#comment-16651797 ] Zhankun Tang commented on YARN-8798: [~sunilg], Thanks for the review. For the empty path, do you

[jira] [Updated] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8880: --- Description: Added two configurations for the pluggable device framework. {code:java}

[jira] [Updated] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8880: --- Description: Added two configurations for the pluggable device framework. {code:java}

[jira] [Updated] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8880: --- Description: Added two configurations for the pluggable device framework. {code:java}

[jira] [Commented] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651747#comment-16651747 ] Zhankun Tang commented on YARN-8880: Add three configurations. Please review. [~leftnoteasy],

[jira] [Updated] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8880: --- Attachment: YARN-8880-trunk.001.patch > Add configurations for pluggable plugin framework >

[jira] [Updated] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8798: --- Attachment: YARN-8798-trunk.001.patch > [Submarine] Job should not be submitted if "--input_path"

[jira] [Updated] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: YARN-8851-WIP4-trunk.001.patch > [Umbrella] A new pluggable device plugin framework to

[jira] [Updated] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8880: --- Description: Added two configurations for the pluggable device framework. {code:java}

[jira] [Created] (YARN-8891) Documentation of the pluggable device framework

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8891: -- Summary: Documentation of the pluggable device framework Key: YARN-8891 URL: https://issues.apache.org/jira/browse/YARN-8891 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8880: --- Description: Added two configurations for the pluggable device framework. {code:java}

[jira] [Updated] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8880: --- Description: Added two configurations for the pluggable device framework. {code:java}

[jira] [Updated] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8880: --- Description: Added two configurations for the pluggable device framework. {code:java}

[jira] [Created] (YARN-8890) Port existing GPU module into pluggable device framework

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8890: -- Summary: Port existing GPU module into pluggable device framework Key: YARN-8890 URL: https://issues.apache.org/jira/browse/YARN-8890 Project: Hadoop YARN Issue

[jira] [Assigned] (YARN-8889) Add well-defined interface in container-executor to support vendor plugins isolation request

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang reassigned YARN-8889: -- Assignee: Zhankun Tang > Add well-defined interface in container-executor to support vendor

[jira] [Updated] (YARN-8889) Add well-defined interface in container-executor to support vendor plugins isolation request

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8889: --- Summary: Add well-defined interface in container-executor to support vendor plugins isolation request

[jira] [Created] (YARN-8889) Added well-defined interface in container-executor to support vendor plugins isolation request

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8889: -- Summary: Added well-defined interface in container-executor to support vendor plugins isolation request Key: YARN-8889 URL: https://issues.apache.org/jira/browse/YARN-8889

[jira] [Created] (YARN-8888) Support device topology scheduling

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-: -- Summary: Support device topology scheduling Key: YARN- URL: https://issues.apache.org/jira/browse/YARN- Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-8887) Support isolation in pluggable device framework

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8887: -- Summary: Support isolation in pluggable device framework Key: YARN-8887 URL: https://issues.apache.org/jira/browse/YARN-8887 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-8886) Support RM API to query aggregated allocation across cluster

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8886: -- Summary: Support RM API to query aggregated allocation across cluster Key: YARN-8886 URL: https://issues.apache.org/jira/browse/YARN-8886 Project: Hadoop YARN

[jira] [Created] (YARN-8885) Support NM APIs to query device resource allocation

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8885: -- Summary: Support NM APIs to query device resource allocation Key: YARN-8885 URL: https://issues.apache.org/jira/browse/YARN-8885 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8884) Support monitoring of device resource through plugin API

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8884: -- Summary: Support monitoring of device resource through plugin API Key: YARN-8884 URL: https://issues.apache.org/jira/browse/YARN-8884 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8883) Provide an example of fake vendor plugin

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8883: -- Summary: Provide an example of fake vendor plugin Key: YARN-8883 URL: https://issues.apache.org/jira/browse/YARN-8883 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-8882) Add a shared device local scheduler for device plugin to use

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8882: -- Summary: Add a shared device local scheduler for device plugin to use Key: YARN-8882 URL: https://issues.apache.org/jira/browse/YARN-8882 Project: Hadoop YARN

[jira] [Created] (YARN-8881) Add basic pluggable device plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8881: -- Summary: Add basic pluggable device plugin framework Key: YARN-8881 URL: https://issues.apache.org/jira/browse/YARN-8881 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-8880) Add configurations for pluggable plugin framework

2018-10-16 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8880: -- Summary: Add configurations for pluggable plugin framework Key: YARN-8880 URL: https://issues.apache.org/jira/browse/YARN-8880 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-10-16 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Summary: [Umbrella] A new pluggable device plugin framework to ease vendor plugin development (was:

[jira] [Updated] (YARN-8851) [Umbrella] A new device plugin framework to ease vendor plugin development

2018-10-15 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: [YARN-8851] YARN_New_Device_Plugin_Framework_Design_Proposal-3.pdf > [Umbrella] A new

[jira] [Commented] (YARN-8851) [Umbrella] A new device plugin framework to ease vendor plugin development

2018-10-15 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650376#comment-16650376 ] Zhankun Tang commented on YARN-8851: Use the more precise configuration setting name. Thanks, 

[jira] [Updated] (YARN-8851) [Umbrella] A new device plugin framework to ease vendor plugin development

2018-10-15 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: YARN-8851-WIP3-trunk.001.patch > [Umbrella] A new device plugin framework to ease vendor

[jira] [Updated] (YARN-8851) [Umbrella] A new device plugin framework to ease vendor plugin development

2018-10-15 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: (was: YARN-8851-WIP-trunk.001.patch) > [Umbrella] A new device plugin framework to

[jira] [Updated] (YARN-8851) [Umbrella] A new device plugin framework to ease vendor plugin development

2018-10-15 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: YARN-8851-WIP2-trunk.001.patch > [Umbrella] A new device plugin framework to ease vendor

[jira] [Updated] (YARN-8851) [Umbrella] A new device plugin framework to ease vendor plugin development

2018-10-14 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: [YARN-8851] YARN_New_Device_Plugin_Framework_Design_Proposal.pdf > [Umbrella] A new

[jira] [Updated] (YARN-8851) [Umbrella] A new device plugin framework to ease vendor plugin development

2018-10-14 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: (was: [YARN-8851] YARN_New_Device_Plugin_Framework_Design_Proposal.pdf) > [Umbrella]

[jira] [Commented] (YARN-8851) [Umbrella] A new device plugin framework to ease vendor plugin development

2018-10-14 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16649287#comment-16649287 ] Zhankun Tang commented on YARN-8851: Attached the design doc and a WIP patch. Please review.

[jira] [Updated] (YARN-8851) [Umbrella] A new device plugin framework to ease vendor plugin development

2018-10-14 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: YARN-8851-WIP-trunk.001.patch > [Umbrella] A new device plugin framework to ease vendor

[jira] [Updated] (YARN-8851) [Umbrella] A new device plugin framework to ease vendor plugin development

2018-10-14 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: [YARN-8851] YARN_New_Device_Plugin_Framework_Design_Proposal.pdf > [Umbrella] A new

[jira] [Created] (YARN-8851) [Umbrella] A new device plugin framework to ease vendor plugin development

2018-10-05 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8851: -- Summary: [Umbrella] A new device plugin framework to ease vendor plugin development Key: YARN-8851 URL: https://issues.apache.org/jira/browse/YARN-8851 Project: Hadoop

[jira] [Commented] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

2018-09-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633040#comment-16633040 ] Zhankun Tang commented on YARN-8798: [~bsteinbach] Thanks for offering the help. We don't have a get

[jira] [Created] (YARN-8823) Monitor the healthy state of GPU

2018-09-25 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8823: -- Summary: Monitor the healthy state of GPU Key: YARN-8823 URL: https://issues.apache.org/jira/browse/YARN-8823 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7481) Gpu locality support for Better AI scheduling

2018-09-25 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627029#comment-16627029 ] Zhankun Tang commented on YARN-7481: [~qinc...@microsoft.com] , we've created a phase 2 Jira for GPU

[jira] [Created] (YARN-8822) Nvidia-docker v2 support

2018-09-25 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8822: -- Summary: Nvidia-docker v2 support Key: YARN-8822 URL: https://issues.apache.org/jira/browse/YARN-8822 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-8821) GPU hierarchy scheduling support

2018-09-25 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8821: -- Summary: GPU hierarchy scheduling support Key: YARN-8821 URL: https://issues.apache.org/jira/browse/YARN-8821 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-8820) [Umbrella] GPU support on YARN - Phase 2

2018-09-25 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8820: -- Summary: [Umbrella] GPU support on YARN - Phase 2 Key: YARN-8820 URL: https://issues.apache.org/jira/browse/YARN-8820 Project: Hadoop YARN Issue Type: New

[jira] [Commented] (YARN-8806) Enable local staging directory and clean it up when submarine job is submitted

2018-09-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623494#comment-16623494 ] Zhankun Tang commented on YARN-8806: [~yuan_zac] Thanks for providing the patch. I also noticed this

[jira] [Commented] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

2018-09-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621442#comment-16621442 ] Zhankun Tang commented on YARN-8725: [~leftnoteasy] Thanks for the explanation. It should have a

[jira] [Comment Edited] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

2018-09-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620834#comment-16620834 ] Zhankun Tang edited comment on YARN-8725 at 9/19/18 4:52 PM: - [~leftnoteasy]

[jira] [Commented] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

2018-09-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620834#comment-16620834 ] Zhankun Tang commented on YARN-8725: [~leftnoteasy] {quote}cleanup whole staging dir seems overkill

[jira] [Updated] (YARN-8799) [Submarine] Correct the default directory path in HDFS for "checkout_path"

2018-09-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8799: --- Description:   {code:java} yarn jar

[jira] [Updated] (YARN-8799) [Submarine] Correct the default directory path in HDFS for "checkout_path"

2018-09-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8799: --- Summary: [Submarine] Correct the default directory path in HDFS for "checkout_path" (was:

[jira] [Created] (YARN-8799) [Submarine] A default directory path in HDFS for "checkout_path"?

2018-09-19 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8799: -- Summary: [Submarine] A default directory path in HDFS for "checkout_path"? Key: YARN-8799 URL: https://issues.apache.org/jira/browse/YARN-8799 Project: Hadoop YARN

[jira] [Created] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

2018-09-19 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8798: -- Summary: [Submarine] Job should not be submitted if "--input_path" option is missing Key: YARN-8798 URL: https://issues.apache.org/jira/browse/YARN-8798 Project: Hadoop

[jira] [Comment Edited] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

2018-09-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617600#comment-16617600 ] Zhankun Tang edited comment on YARN-8725 at 9/17/18 2:36 PM: - Added a patch

[jira] [Commented] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

2018-09-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617600#comment-16617600 ] Zhankun Tang commented on YARN-8725: Added a patch which does following: # add a new option

[jira] [Updated] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

2018-09-17 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8725: --- Attachment: YARN-8725-trunk.001.patch > Submarine job staging directory has a lot of useless >

[jira] [Commented] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

2018-08-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594966#comment-16594966 ] Zhankun Tang commented on YARN-8725: [~yuan_zac] Thanks for pointing this. We should clean up the

[jira] [Assigned] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

2018-08-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang reassigned YARN-8725: -- Assignee: Zhankun Tang (was: Zac Zhou) > Submarine job staging directory has a lot of useless

[jira] [Comment Edited] (YARN-8698) [Submarine] Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594738#comment-16594738 ] Zhankun Tang edited comment on YARN-8698 at 8/28/18 9:27 AM: - [~yuan_zac] 

[jira] [Comment Edited] (YARN-8698) [Submarine] Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594738#comment-16594738 ] Zhankun Tang edited comment on YARN-8698 at 8/28/18 9:23 AM: - [~yuan_zac] 

[jira] [Commented] (YARN-8698) [Submarine] Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16594738#comment-16594738 ] Zhankun Tang commented on YARN-8698: [~yuan_zac] I've reproduced your issue and double-checked the

[jira] [Comment Edited] (YARN-8563) [Submarine] Support users to specify Python/TF package/version/dependencies for training job.

2018-08-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592475#comment-16592475 ] Zhankun Tang edited comment on YARN-8563 at 8/25/18 5:41 AM: - [~leftnoteasy]

[jira] [Comment Edited] (YARN-8563) [Submarine] Support users to specify Python/TF package/version/dependencies for training job.

2018-08-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592475#comment-16592475 ] Zhankun Tang edited comment on YARN-8563 at 8/25/18 5:40 AM: - [~leftnoteasy]

[jira] [Comment Edited] (YARN-8563) [Submarine] Support users to specify Python/TF package/version/dependencies for training job.

2018-08-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592475#comment-16592475 ] Zhankun Tang edited comment on YARN-8563 at 8/25/18 5:38 AM: - [~leftnoteasy]

<    3   4   5   6   7   8   9   10   11   >