[jira] [Updated] (YARN-8892) YARN UI2 doc improvement to update security status

[ https://issues.apache.org/jira/browse/YARN-8892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8892: - Priority: Blocker (was: Major) > YARN UI2 doc improvement to update security status > ---

[jira] [Comment Edited] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652271#comment-16652271 ] Wangda Tan edited comment on YARN-8489 at 10/16/18 7:42 PM: [~

[jira] [Comment Edited] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652271#comment-16652271 ] Wangda Tan edited comment on YARN-8489 at 10/16/18 7:41 PM: [~

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652271#comment-16652271 ] Wangda Tan commented on YARN-8489: -- [~eyang], Basically there're four models in submarin

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652163#comment-16652163 ] Wangda Tan commented on YARN-8489: -- [~eyang],  I have thought about this, but it seems t

[jira] [Updated] (YARN-8875) [Submarine] Add documentation for submarine installation script details

[ https://issues.apache.org/jira/browse/YARN-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8875: - Attachment: YARN-8875.005.patch > [Submarine] Add documentation for submarine installation script details

[jira] [Commented] (YARN-8875) [Submarine] Add documentation for submarine installation script details

[ https://issues.apache.org/jira/browse/YARN-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652101#comment-16652101 ] Wangda Tan commented on YARN-8875: -- Fixed doc issues I mentioned above. (005)  > [Submar

[jira] [Commented] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

[ https://issues.apache.org/jira/browse/YARN-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652046#comment-16652046 ] Wangda Tan commented on YARN-8798: -- +1, thanks [~tangzhankun]. [~sunilg], please let me k

[jira] [Updated] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

[ https://issues.apache.org/jira/browse/YARN-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8798: - Target Version/s: 3.2.0 Priority: Critical (was: Major) > [Submarine] Job should not be submi

[jira] [Commented] (YARN-8879) Kerberos principal is needed when submitting a submarine job

[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652036#comment-16652036 ] Wangda Tan commented on YARN-8879: -- +1, thanks [~sunilg], please go ahead and get it comm

[jira] [Updated] (YARN-8879) Kerberos principal is needed when submitting a submarine job

[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8879: - Priority: Critical (was: Major) > Kerberos principal is needed when submitting a submarine job >

[jira] [Updated] (YARN-8879) Kerberos principal is needed when submitting a submarine job

[ https://issues.apache.org/jira/browse/YARN-8879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8879: - Target Version/s: 3.2.0 > Kerberos principal is needed when submitting a submarine job > -

[jira] [Commented] (YARN-8875) [Submarine] Add documentation for submarine installation script details

[ https://issues.apache.org/jira/browse/YARN-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16651181#comment-16651181 ] Wangda Tan commented on YARN-8875: -- Thanks [~liuxun323]. More comments: 1) Inside Inde

[jira] [Commented] (YARN-8876) [Submarine] Job monitor long-running service of submarine

[ https://issues.apache.org/jira/browse/YARN-8876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16650823#comment-16650823 ] Wangda Tan commented on YARN-8876: -- Thanks [~liuxun323],   The termination of each jobs

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8489: - Description: Existing YARN service support termination policy for different restart policies. For example

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16650816#comment-16650816 ] Wangda Tan commented on YARN-8489: -- Updated title/description, dropped the pluggable part

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8489: - Description: Existing YARN service support termination policy for different restart policies. For example

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8489: - Summary: Need to support "dominant" component concept inside YARN service (was: Need to support pluggable

[jira] [Commented] (YARN-8836) Add tags and attributes in resource definition

[ https://issues.apache.org/jira/browse/YARN-8836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16650803#comment-16650803 ] Wangda Tan commented on YARN-8836: -- [~cheersyang], [~sunilg],  I remember we discussed b

[jira] [Commented] (YARN-8875) [Submarine] Add documentation for submarine installation script details

[ https://issues.apache.org/jira/browse/YARN-8875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16650782#comment-16650782 ] Wangda Tan commented on YARN-8875: -- Thanks [~liuxun323]. [~sunilg], I'm checking the lat

[jira] [Commented] (YARN-8870) [Submarine] Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16650775#comment-16650775 ] Wangda Tan commented on YARN-8870: -- Thanks [~liuxun323], patch looks good to me. I will c

[jira] [Updated] (YARN-8870) Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8870: - Target Version/s: 3.2.0 > Add submarine installation scripts > -- > >

[jira] [Updated] (YARN-8870) Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8870: - Priority: Critical (was: Major) > Add submarine installation scripts > --

[jira] [Assigned] (YARN-8870) Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-8870: Assignee: Wangda Tan > Add submarine installation scripts > -- > >

[jira] [Assigned] (YARN-8870) Add submarine installation scripts

[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-8870: Assignee: Xun Liu (was: Wangda Tan) > Add submarine installation scripts > ---

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644427#comment-16644427 ] Wangda Tan commented on YARN-8569: -- [~eyang],    {quote}In sync_yarn_sysfs, check_nm_loc

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644223#comment-16644223 ] Wangda Tan commented on YARN-8569: -- Discussed with [~eyang]/[~suma.shivaprasad] offline, 

[jira] [Comment Edited] (YARN-8852) Add documentation for submarine installation details

[ https://issues.apache.org/jira/browse/YARN-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16643766#comment-16643766 ] Wangda Tan edited comment on YARN-8852 at 10/9/18 8:38 PM: --- Comm

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8858: - Attachment: YARN-8858.002.patch > CapacityScheduler should respect maximum node resource when per-queue >

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644058#comment-16644058 ] Wangda Tan commented on YARN-8858: -- Attached ver.2 patch, addressed all comments. > Capa

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16644040#comment-16644040 ] Wangda Tan commented on YARN-8468: -- [~bsteinbach],  It could be caused by some test issu

[jira] [Updated] (YARN-8852) Add documentation for submarine installation details

[ https://issues.apache.org/jira/browse/YARN-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8852: - Component/s: submarine > Add documentation for submarine installation details > --

[jira] [Updated] (YARN-8852) Add documentation for submarine installation details

[ https://issues.apache.org/jira/browse/YARN-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8852: - Component/s: documentation > Add documentation for submarine installation details > --

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16643732#comment-16643732 ] Wangda Tan commented on YARN-8858: -- Thanks [~cheersyang] for the review., they should not

[jira] [Commented] (YARN-8852) Add documentation for submarine installation details

[ https://issues.apache.org/jira/browse/YARN-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16643730#comment-16643730 ] Wangda Tan commented on YARN-8852: -- +1, will commit patch shortly. > Add documentation f

[jira] [Comment Edited] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642828#comment-16642828 ] Wangda Tan edited comment on YARN-8858 at 10/9/18 5:39 AM: --- [~ch

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16642828#comment-16642828 ] Wangda Tan commented on YARN-8858: -- [~cheersyang] / [~sunil.gov...@gmail.com], can we get

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8858: - Attachment: YARN-8858.001.patch > CapacityScheduler should respect maximum node resource when per-queue >

[jira] [Created] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

Wangda Tan created YARN-8858: Summary: CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used. Key: YARN-8858 URL: https://issues.apache.org/jira/browse/YARN-8858

[jira] [Commented] (YARN-8852) Add documentation for submarine installation details

[ https://issues.apache.org/jira/browse/YARN-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640848#comment-16640848 ] Wangda Tan commented on YARN-8852: -- Thanks [~yuan_zac], this will be super helpful!  Som

[jira] [Commented] (YARN-8849) DynoYARN: A simulation and testing infrastructure for YARN clusters

[ https://issues.apache.org/jira/browse/YARN-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640147#comment-16640147 ] Wangda Tan commented on YARN-8849: -- Thanks [~asuresh] and [~oliverhuh...@gmail.com] filin

[jira] [Commented] (YARN-8767) TestStreamingStatus fails

[ https://issues.apache.org/jira/browse/YARN-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640131#comment-16640131 ] Wangda Tan commented on YARN-8767: -- Thanks [~boky01], fix makes sense to me. Will commit

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16640125#comment-16640125 ] Wangda Tan commented on YARN-8627: -- Thanks [~rohithsharma] for reviewing the patch. [~ta

[jira] [Comment Edited] (YARN-8758) Support getting PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638618#comment-16638618 ] Wangda Tan edited comment on YARN-8758 at 10/4/18 5:54 PM: --- Comm

[jira] [Commented] (YARN-8844) TestNMProxy unit test is failing

[ https://issues.apache.org/jira/browse/YARN-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16638606#comment-16638606 ] Wangda Tan commented on YARN-8844: -- Fix LGTM, thanks [~eyang]. > TestNMProxy unit test i

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8468: - Component/s: scheduler > Enable the use of queue based maximum container allocation limit and > implement

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8468: - Fix Version/s: (was: 3.3.0) > Enable the use of queue based maximum container allocation limit and >

[jira] [Commented] (YARN-8758) Support getting PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16634405#comment-16634405 ] Wangda Tan commented on YARN-8758: -- Thanks [~Zian Chen], patch LGTM, +1. Will commit tomo

[jira] [Updated] (YARN-8758) Support getting PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8758: - Summary: Support getting PreemptionMessage when using AMRMClientAsync (was: PreemptionMessage when using

[jira] [Updated] (YARN-8758) PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8758: - Description: There's no way to get PreemptionMessage sent by RM from AMRMClientAsync, we should add suppor

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630857#comment-16630857 ] Wangda Tan commented on YARN-8800: -- Found the images are problematic because of the size.

[jira] [Updated] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8800: - Attachment: YARN-8800.005.patch > Updated documentation of Submarine with latest examples. > -

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630534#comment-16630534 ] Wangda Tan commented on YARN-8800: -- Please hold on, there're a few issues of the images,

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16629713#comment-16629713 ] Wangda Tan commented on YARN-8800: -- [~sunilg], tried to use command:  {code:java} mvn cle

[jira] [Updated] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8800: - Attachment: YARN-8800.004.patch > Updated documentation of Submarine with latest examples. > -

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16627708#comment-16627708 ] Wangda Tan commented on YARN-8800: -- Attached ver.3 patch solved SC/ASF warnings. > Updat

[jira] [Updated] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8800: - Attachment: YARN-8800.003.patch > Updated documentation of Submarine with latest examples. > -

[jira] [Commented] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626619#comment-16626619 ] Wangda Tan commented on YARN-8817: -- Verified this in a cluster. > [Submarine] In some ca

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626618#comment-16626618 ] Wangda Tan commented on YARN-8800: -- Attached ver.2 patch includes notebooks examples as w

[jira] [Updated] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8800: - Attachment: YARN-8800.002.patch > Updated documentation of Submarine with latest examples. > -

[jira] [Commented] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626568#comment-16626568 ] Wangda Tan commented on YARN-8817: -- The root cause is:  In any case we will generate che

[jira] [Commented] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626569#comment-16626569 ] Wangda Tan commented on YARN-8817: -- cc: [~sunilg] > [Submarine] In some cases HDFS is no

[jira] [Updated] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8817: - Attachment: YARN-8817.001.patch > [Submarine] In some cases HDFS is not asked by user when submit job but

[jira] [Assigned] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-8817: Assignee: Wangda Tan > [Submarine] In some cases HDFS is not asked by user when submit job but > f

[jira] [Created] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

Wangda Tan created YARN-8817: Summary: [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments Key: YARN-8817 URL: https://issues.apache.org/jir

[jira] [Updated] (YARN-8734) Readiness check for remote service belongs to the same user

[ https://issues.apache.org/jira/browse/YARN-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8734: - Summary: Readiness check for remote service belongs to the same user (was: Readiness check for remote ser

[jira] [Updated] (YARN-8758) PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8758: - Target Version/s: 3.1.2 (was: 3.1.1) > PreemptionMessage when using AMRMClientAsync > ---

[jira] [Updated] (YARN-8758) PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8758: - Fix Version/s: (was: 2.7.6) > PreemptionMessage when using AMRMClientAsync > -

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626418#comment-16626418 ] Wangda Tan commented on YARN-8627: -- [~rohithsharma], could u help to review the latest co

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16626345#comment-16626345 ] Wangda Tan commented on YARN-8800: -- Attached ver.1 patch, includes some screenshots that'

[jira] [Updated] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8800: - Attachment: YARN-8800.001.patch > Updated documentation of Submarine with latest examples. > -

[jira] [Commented] (YARN-8785) Error Message "Invalid docker rw mount" not helpful

[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16624109#comment-16624109 ] Wangda Tan commented on YARN-8785: -- [~simonprewo], instead of uploading patch file, you c

[jira] [Commented] (YARN-8806) Enable local staging directory and clean it up when submarine job is submitted

[ https://issues.apache.org/jira/browse/YARN-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623985#comment-16623985 ] Wangda Tan commented on YARN-8806: -- [~yuan_zac], I think we should create a process when

[jira] [Commented] (YARN-8563) [Submarine] Support users to specify Python/TF package/version/dependencies for training job.

[ https://issues.apache.org/jira/browse/YARN-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623970#comment-16623970 ] Wangda Tan commented on YARN-8563: -- Thanks [~liuxun323],  The primary purpose of this ti

[jira] [Commented] (YARN-8811) Support Container Storage Interface (CSI) in YARN

[ https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16623901#comment-16623901 ] Wangda Tan commented on YARN-8811: -- Thanks [~cheersyang], [~sunilg] for the design doc. 

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622460#comment-16622460 ] Wangda Tan commented on YARN-8804: -- Thanks [~Tao Yang] for the nice analysis, I'm not sur

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622355#comment-16622355 ] Wangda Tan commented on YARN-8468: -- Thanks [~bsteinbach], I think YARN-8720 only covers

[jira] [Updated] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8769: - Attachment: YARN-8769.004.patch > [Submarine] Allow user to specify customized quicklink(s) when submit >

[jira] [Resolved] (YARN-8799) [Submarine] Correct the default directory path in HDFS for "checkout_path"

[ https://issues.apache.org/jira/browse/YARN-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8799. -- Resolution: Duplicate This should be duplicated by YARN-8757.  > [Submarine] Correct the default direct

[jira] [Commented] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621339#comment-16621339 ] Wangda Tan commented on YARN-8725: -- Thanks [~tangzhankun],  {quote}But the job failed due

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621328#comment-16621328 ] Wangda Tan commented on YARN-8769: -- Attached ver.3 patch fixed checkstyle and findbugs is

[jira] [Updated] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8769: - Attachment: YARN-8769.003.patch > [Submarine] Allow user to specify customized quicklink(s) when submit >

[jira] [Created] (YARN-8800) Updated documentation of Submarine with latest examples.

Wangda Tan created YARN-8800: Summary: Updated documentation of Submarine with latest examples. Key: YARN-8800 URL: https://issues.apache.org/jira/browse/YARN-8800 Project: Hadoop YARN Issue Type

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621042#comment-16621042 ] Wangda Tan commented on YARN-8769: -- Thanks [~sunilg], attached ver.2 > [Submarine] Allow

[jira] [Updated] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8769: - Attachment: YARN-8769.002.patch > [Submarine] Allow user to specify customized quicklink(s) when submit >

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16621002#comment-16621002 ] Wangda Tan commented on YARN-8468: -- [~cheersyang],  I saw YARN-8720 just committed, what

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8771: - Target Version/s: 3.1.1, 3.2.0 > CapacityScheduler fails to unreserve when cluster resource contains empty

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16619835#comment-16619835 ] Wangda Tan commented on YARN-8771: -- Nice catch! Thanks [~Tao Yang].  Patch LGTM as well.

[jira] [Commented] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16619480#comment-16619480 ] Wangda Tan commented on YARN-8725: -- [~tangzhankun], cleanup whole staging dir seems overk

[jira] [Commented] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16619469#comment-16619469 ] Wangda Tan commented on YARN-8757: -- Thanks [~sunilg],  For 1. The default case is alread

[jira] [Updated] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8757: - Attachment: YARN-8757.003.patch > [Submarine] Add Tensorboard component when --tensorboard is specified >

[jira] [Deleted] (YARN-8773) Blacklisting support for scheduling AMs

[ https://issues.apache.org/jira/browse/YARN-8773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan deleted YARN-8773: - > Blacklisting support for scheduling AMs > > > Key

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612989#comment-16612989 ] Wangda Tan commented on YARN-8769: -- Attached ver.1 patch, this patch depends on YARN-8757

[jira] [Comment Edited] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612989#comment-16612989 ] Wangda Tan edited comment on YARN-8769 at 9/13/18 4:16 AM: --- Atta

[jira] [Updated] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8769: - Attachment: YARN-8769.001.patch > [Submarine] Allow user to specify customized quicklink(s) when submit >

[jira] [Created] (YARN-8770) [Submarine] Support using Submarine to submit Pytorch job

Wangda Tan created YARN-8770: Summary: [Submarine] Support using Submarine to submit Pytorch job Key: YARN-8770 URL: https://issues.apache.org/jira/browse/YARN-8770 Project: Hadoop YARN Issue Typ

[jira] [Created] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

Wangda Tan created YARN-8769: Summary: [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job Key: YARN-8769 URL: https://issues.apache.org/jira/browse/YARN-8769 Project: Hado

[jira] [Updated] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8757: - Attachment: YARN-8757.002.patch > [Submarine] Add Tensorboard component when --tensorboard is specified >

[jira] [Commented] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16611043#comment-16611043 ] Wangda Tan commented on YARN-8757: -- Attached ver.2 patch, fixed findbugs warnings and che

[jira] [Updated] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8757: - Target Version/s: 3.2.0 Priority: Critical (was: Major) > [Submarine] Add Tensorboard compone

<    1   2   3   4   5   6   7   8   9   10   >