[jira] [Updated] (YARN-8892) YARN UI2 doc improvement to update security status

[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8892: - Priority: Blocker (was: Major) > YARN UI2 doc improvement to update security status >

[jira] [Comment Edited] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652271#comment-16652271 ] Wangda Tan edited comment on YARN-8489 at 10/16/18 7:42 PM: [~eyang],

[jira] [Comment Edited] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652271#comment-16652271 ] Wangda Tan edited comment on YARN-8489 at 10/16/18 7:41 PM: [~eyang],

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652271#comment-16652271 ] Wangda Tan commented on YARN-8489: -- [~eyang], Basically there're four models in submarine for training

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652163#comment-16652163 ] Wangda Tan commented on YARN-8489: -- [~eyang],  I have thought about this, but it seems to me both

[jira] [Updated] (YARN-8875) [Submarine] Add documentation for submarine installation script details

[ https://issues.apache.org/jira/browse/YARN-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8875: - Attachment: YARN-8875.005.patch > [Submarine] Add documentation for submarine installation script details

[jira] [Commented] (YARN-8875) [Submarine] Add documentation for submarine installation script details

[ https://issues.apache.org/jira/browse/YARN-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652101#comment-16652101 ] Wangda Tan commented on YARN-8875: -- Fixed doc issues I mentioned above. (005)  > [Submarine] Add

[jira] [Commented] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

[ https://issues.apache.org/jira/browse/YARN-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652046#comment-16652046 ] Wangda Tan commented on YARN-8798: -- +1, thanks [~tangzhankun]. [~sunilg], please let me know if you have

[jira] [Updated] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

[ https://issues.apache.org/jira/browse/YARN-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8798: - Target Version/s: 3.2.0 Priority: Critical (was: Major) > [Submarine] Job should not be

[jira] [Commented] (YARN-8879) Kerberos principal is needed when submitting a submarine job

[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652036#comment-16652036 ] Wangda Tan commented on YARN-8879: -- +1, thanks [~sunilg], please go ahead and get it committed. >

[jira] [Updated] (YARN-8879) Kerberos principal is needed when submitting a submarine job

[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8879: - Priority: Critical (was: Major) > Kerberos principal is needed when submitting a submarine job >

[jira] [Updated] (YARN-8879) Kerberos principal is needed when submitting a submarine job

[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8879: - Target Version/s: 3.2.0 > Kerberos principal is needed when submitting a submarine job >

[jira] [Commented] (YARN-8875) [Submarine] Add documentation for submarine installation script details

[ https://issues.apache.org/jira/browse/YARN-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651181#comment-16651181 ] Wangda Tan commented on YARN-8875: -- Thanks [~liuxun323]. More comments: 1) Inside Index.md, should

[jira] [Commented] (YARN-8876) [Submarine] Job monitor long-running service of submarine

[ https://issues.apache.org/jira/browse/YARN-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650823#comment-16650823 ] Wangda Tan commented on YARN-8876: -- Thanks [~liuxun323],   The termination of each jobs should be

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8489: - Description: Existing YARN service support termination policy for different restart policies. For

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650816#comment-16650816 ] Wangda Tan commented on YARN-8489: -- Updated title/description, dropped the pluggable part. To me the

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8489: - Description: Existing YARN service support termination policy for different restart policies. For

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8489: - Summary: Need to support "dominant" component concept inside YARN service (was: Need to support

[jira] [Commented] (YARN-8836) Add tags and attributes in resource definition

[ https://issues.apache.org/jira/browse/YARN-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650803#comment-16650803 ] Wangda Tan commented on YARN-8836: -- [~cheersyang], [~sunilg],  I remember we discussed before that

[jira] [Commented] (YARN-8875) [Submarine] Add documentation for submarine installation script details

[ https://issues.apache.org/jira/browse/YARN-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650782#comment-16650782 ] Wangda Tan commented on YARN-8875: -- Thanks [~liuxun323]. [~sunilg], I'm checking the latest attached

[jira] [Commented] (YARN-8870) [Submarine] Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650775#comment-16650775 ] Wangda Tan commented on YARN-8870: -- Thanks [~liuxun323], patch looks good to me. I will commit the patch

[jira] [Updated] (YARN-8870) Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8870: - Target Version/s: 3.2.0 > Add submarine installation scripts > -- > >

[jira] [Updated] (YARN-8870) Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8870: - Priority: Critical (was: Major) > Add submarine installation scripts >

[jira] [Assigned] (YARN-8870) Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-8870: Assignee: Wangda Tan > Add submarine installation scripts > -- > >

[jira] [Assigned] (YARN-8870) Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-8870: Assignee: Xun Liu (was: Wangda Tan) > Add submarine installation scripts >

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644427#comment-16644427 ] Wangda Tan commented on YARN-8569: -- [~eyang],    {quote}In sync_yarn_sysfs, check_nm_local_dir make sure

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644223#comment-16644223 ] Wangda Tan commented on YARN-8569: -- Discussed with [~eyang]/[~suma.shivaprasad] offline,  Several

[jira] [Comment Edited] (YARN-8852) Add documentation for submarine installation details

[ https://issues.apache.org/jira/browse/YARN-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643766#comment-16643766 ] Wangda Tan edited comment on YARN-8852 at 10/9/18 8:38 PM: --- Committed to

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8858: - Attachment: YARN-8858.002.patch > CapacityScheduler should respect maximum node resource when per-queue

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644058#comment-16644058 ] Wangda Tan commented on YARN-8858: -- Attached ver.2 patch, addressed all comments. > CapacityScheduler

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644040#comment-16644040 ] Wangda Tan commented on YARN-8468: -- [~bsteinbach],  It could be caused by some test issue:  {code:java}

[jira] [Updated] (YARN-8852) Add documentation for submarine installation details

[ https://issues.apache.org/jira/browse/YARN-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8852: - Component/s: submarine > Add documentation for submarine installation details >

[jira] [Updated] (YARN-8852) Add documentation for submarine installation details

[ https://issues.apache.org/jira/browse/YARN-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8852: - Component/s: documentation > Add documentation for submarine installation details >

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643732#comment-16643732 ] Wangda Tan commented on YARN-8858: -- Thanks [~cheersyang] for the review., they should not be necessary,

[jira] [Commented] (YARN-8852) Add documentation for submarine installation details

[ https://issues.apache.org/jira/browse/YARN-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643730#comment-16643730 ] Wangda Tan commented on YARN-8852: -- +1, will commit patch shortly. > Add documentation for submarine

[jira] [Comment Edited] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642828#comment-16642828 ] Wangda Tan edited comment on YARN-8858 at 10/9/18 5:39 AM: --- [~cheersyang] /

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642828#comment-16642828 ] Wangda Tan commented on YARN-8858: -- [~cheersyang] / [~sunil.gov...@gmail.com], can we get this patch

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8858: - Attachment: YARN-8858.001.patch > CapacityScheduler should respect maximum node resource when per-queue

[jira] [Created] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

Wangda Tan created YARN-8858: Summary: CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used. Key: YARN-8858 URL: https://issues.apache.org/jira/browse/YARN-8858

[jira] [Commented] (YARN-8852) Add documentation for submarine installation details

[ https://issues.apache.org/jira/browse/YARN-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640848#comment-16640848 ] Wangda Tan commented on YARN-8852: -- Thanks [~yuan_zac], this will be super helpful!  Some comments:  1)

[jira] [Commented] (YARN-8849) DynoYARN: A simulation and testing infrastructure for YARN clusters

[ https://issues.apache.org/jira/browse/YARN-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640147#comment-16640147 ] Wangda Tan commented on YARN-8849: -- Thanks [~asuresh] and [~oliverhuh...@gmail.com] filing the proposal.

[jira] [Commented] (YARN-8767) TestStreamingStatus fails

[ https://issues.apache.org/jira/browse/YARN-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640131#comment-16640131 ] Wangda Tan commented on YARN-8767: -- Thanks [~boky01], fix makes sense to me. Will commit today if no

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640125#comment-16640125 ] Wangda Tan commented on YARN-8627: -- Thanks [~rohithsharma] for reviewing the patch. [~tarunparimi],

[jira] [Comment Edited] (YARN-8758) Support getting PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638618#comment-16638618 ] Wangda Tan edited comment on YARN-8758 at 10/4/18 5:54 PM: --- Committed to

[jira] [Commented] (YARN-8844) TestNMProxy unit test is failing

[ https://issues.apache.org/jira/browse/YARN-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638606#comment-16638606 ] Wangda Tan commented on YARN-8844: -- Fix LGTM, thanks [~eyang]. > TestNMProxy unit test is failing >

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8468: - Component/s: scheduler > Enable the use of queue based maximum container allocation limit and >

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8468: - Fix Version/s: (was: 3.3.0) > Enable the use of queue based maximum container allocation limit and >

[jira] [Commented] (YARN-8758) Support getting PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634405#comment-16634405 ] Wangda Tan commented on YARN-8758: -- Thanks [~Zian Chen], patch LGTM, +1. Will commit tomorrow if no

[jira] [Updated] (YARN-8758) Support getting PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8758: - Summary: Support getting PreemptionMessage when using AMRMClientAsync (was: PreemptionMessage when using

[jira] [Updated] (YARN-8758) PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8758: - Description: There's no way to get PreemptionMessage sent by RM from AMRMClientAsync, we should add

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630857#comment-16630857 ] Wangda Tan commented on YARN-8800: -- Found the images are problematic because of the size. Removed all

[jira] [Updated] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8800: - Attachment: YARN-8800.005.patch > Updated documentation of Submarine with latest examples. >

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16630534#comment-16630534 ] Wangda Tan commented on YARN-8800: -- Please hold on, there're a few issues of the images, let me fix it

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629713#comment-16629713 ] Wangda Tan commented on YARN-8800: -- [~sunilg], tried to use command:  {code:java} mvn clean site:site

[jira] [Updated] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8800: - Attachment: YARN-8800.004.patch > Updated documentation of Submarine with latest examples. >

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627708#comment-16627708 ] Wangda Tan commented on YARN-8800: -- Attached ver.3 patch solved SC/ASF warnings. > Updated documentation

[jira] [Updated] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8800: - Attachment: YARN-8800.003.patch > Updated documentation of Submarine with latest examples. >

[jira] [Commented] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626619#comment-16626619 ] Wangda Tan commented on YARN-8817: -- Verified this in a cluster. > [Submarine] In some cases HDFS is not

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626618#comment-16626618 ] Wangda Tan commented on YARN-8800: -- Attached ver.2 patch includes notebooks examples as well. > Updated

[jira] [Updated] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8800: - Attachment: YARN-8800.002.patch > Updated documentation of Submarine with latest examples. >

[jira] [Commented] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626568#comment-16626568 ] Wangda Tan commented on YARN-8817: -- The root cause is:  In any case we will generate checkpoint_path,

[jira] [Commented] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626569#comment-16626569 ] Wangda Tan commented on YARN-8817: -- cc: [~sunilg] > [Submarine] In some cases HDFS is not asked by user

[jira] [Updated] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8817: - Attachment: YARN-8817.001.patch > [Submarine] In some cases HDFS is not asked by user when submit job but

[jira] [Assigned] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-8817: Assignee: Wangda Tan > [Submarine] In some cases HDFS is not asked by user when submit job but >

[jira] [Created] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

Wangda Tan created YARN-8817: Summary: [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments Key: YARN-8817 URL:

[jira] [Updated] (YARN-8734) Readiness check for remote service belongs to the same user

[ https://issues.apache.org/jira/browse/YARN-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8734: - Summary: Readiness check for remote service belongs to the same user (was: Readiness check for remote

[jira] [Updated] (YARN-8758) PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8758: - Target Version/s: 3.1.2 (was: 3.1.1) > PreemptionMessage when using AMRMClientAsync >

[jira] [Updated] (YARN-8758) PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8758: - Fix Version/s: (was: 2.7.6) > PreemptionMessage when using AMRMClientAsync >

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626418#comment-16626418 ] Wangda Tan commented on YARN-8627: -- [~rohithsharma], could u help to review the latest comment? >

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626345#comment-16626345 ] Wangda Tan commented on YARN-8800: -- Attached ver.1 patch, includes some screenshots that's why size of

[jira] [Updated] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8800: - Attachment: YARN-8800.001.patch > Updated documentation of Submarine with latest examples. >

[jira] [Commented] (YARN-8785) Error Message "Invalid docker rw mount" not helpful

[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624109#comment-16624109 ] Wangda Tan commented on YARN-8785: -- [~simonprewo], instead of uploading patch file, you can rename the

[jira] [Commented] (YARN-8806) Enable local staging directory and clean it up when submarine job is submitted

[ https://issues.apache.org/jira/browse/YARN-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623985#comment-16623985 ] Wangda Tan commented on YARN-8806: -- [~yuan_zac], I think we should create a process when submit jobs.

[jira] [Commented] (YARN-8563) [Submarine] Support users to specify Python/TF package/version/dependencies for training job.

[ https://issues.apache.org/jira/browse/YARN-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623970#comment-16623970 ] Wangda Tan commented on YARN-8563: -- Thanks [~liuxun323],  The primary purpose of this ticket is to avoid

[jira] [Commented] (YARN-8811) Support Container Storage Interface (CSI) in YARN

[ https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623901#comment-16623901 ] Wangda Tan commented on YARN-8811: -- Thanks [~cheersyang], [~sunilg] for the design doc.  In general the

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622460#comment-16622460 ] Wangda Tan commented on YARN-8804: -- Thanks [~Tao Yang] for the nice analysis, I'm not sure if YARN-8513

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622355#comment-16622355 ] Wangda Tan commented on YARN-8468: -- Thanks [~bsteinbach], I think YARN-8720 only covers the enforcement

[jira] [Updated] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8769: - Attachment: YARN-8769.004.patch > [Submarine] Allow user to specify customized quicklink(s) when submit

[jira] [Resolved] (YARN-8799) [Submarine] Correct the default directory path in HDFS for "checkout_path"

[ https://issues.apache.org/jira/browse/YARN-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8799. -- Resolution: Duplicate This should be duplicated by YARN-8757.  > [Submarine] Correct the default

[jira] [Commented] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621339#comment-16621339 ] Wangda Tan commented on YARN-8725: -- Thanks [~tangzhankun],  {quote}But the job failed due to invalid path

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621328#comment-16621328 ] Wangda Tan commented on YARN-8769: -- Attached ver.3 patch fixed checkstyle and findbugs issues.  >

[jira] [Updated] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8769: - Attachment: YARN-8769.003.patch > [Submarine] Allow user to specify customized quicklink(s) when submit

[jira] [Created] (YARN-8800) Updated documentation of Submarine with latest examples.

Wangda Tan created YARN-8800: Summary: Updated documentation of Submarine with latest examples. Key: YARN-8800 URL: https://issues.apache.org/jira/browse/YARN-8800 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621042#comment-16621042 ] Wangda Tan commented on YARN-8769: -- Thanks [~sunilg], attached ver.2 > [Submarine] Allow user to specify

[jira] [Updated] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8769: - Attachment: YARN-8769.002.patch > [Submarine] Allow user to specify customized quicklink(s) when submit

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621002#comment-16621002 ] Wangda Tan commented on YARN-8468: -- [~cheersyang],  I saw YARN-8720 just committed, what is the

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8771: - Target Version/s: 3.1.1, 3.2.0 > CapacityScheduler fails to unreserve when cluster resource contains

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619835#comment-16619835 ] Wangda Tan commented on YARN-8771: -- Nice catch! Thanks [~Tao Yang].  Patch LGTM as well. For the test,

[jira] [Commented] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619480#comment-16619480 ] Wangda Tan commented on YARN-8725: -- [~tangzhankun], cleanup whole staging dir seems overkill because

[jira] [Commented] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619469#comment-16619469 ] Wangda Tan commented on YARN-8757: -- Thanks [~sunilg],  For 1. The default case is already handled by

[jira] [Updated] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8757: - Attachment: YARN-8757.003.patch > [Submarine] Add Tensorboard component when --tensorboard is specified >

[jira] [Deleted] (YARN-8773) Blacklisting support for scheduling AMs

[ https://issues.apache.org/jira/browse/YARN-8773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan deleted YARN-8773: - > Blacklisting support for scheduling AMs > > >

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612989#comment-16612989 ] Wangda Tan commented on YARN-8769: -- Attached ver.1 patch, this patch depends on YARN-8757. > [Submarine]

[jira] [Comment Edited] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612989#comment-16612989 ] Wangda Tan edited comment on YARN-8769 at 9/13/18 4:16 AM: --- Attached ver.1

[jira] [Updated] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8769: - Attachment: YARN-8769.001.patch > [Submarine] Allow user to specify customized quicklink(s) when submit

[jira] [Created] (YARN-8770) [Submarine] Support using Submarine to submit Pytorch job

Wangda Tan created YARN-8770: Summary: [Submarine] Support using Submarine to submit Pytorch job Key: YARN-8770 URL: https://issues.apache.org/jira/browse/YARN-8770 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

Wangda Tan created YARN-8769: Summary: [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job Key: YARN-8769 URL: https://issues.apache.org/jira/browse/YARN-8769 Project:

[jira] [Updated] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8757: - Attachment: YARN-8757.002.patch > [Submarine] Add Tensorboard component when --tensorboard is specified >

[jira] [Commented] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611043#comment-16611043 ] Wangda Tan commented on YARN-8757: -- Attached ver.2 patch, fixed findbugs warnings and checkstyle issues.

[jira] [Updated] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8757: - Target Version/s: 3.2.0 Priority: Critical (was: Major) > [Submarine] Add Tensorboard

<    1   2   3   4   5   6   7   8   9   10   >