[jira] [Commented] (YARN-9721) An easy method to exclude a nodemanager from the yarn cluster cleanly

2019-08-07 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902027#comment-16902027 ] Zac Zhou commented on YARN-9721: Thanks, [~tangzhankun], I prefer method 1 and 2.  Method 2 can work the

[jira] [Commented] (YARN-9721) An easy method to exclude a nodemanager from the yarn cluster cleanly

2019-08-06 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900727#comment-16900727 ] Zac Zhou commented on YARN-9721:   [~sunilg] Thanks a lot for your comments~ Maybe I could use some

[jira] [Updated] (YARN-9721) An easy method to exclude a nodemanager from the yarn cluster cleanly

2019-08-05 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9721: --- Description: If we want to take offline a nodemanager server, nodes.exclude-path and "rmadmin -refreshNodes"

[jira] [Updated] (YARN-9721) An easy method to exclude a nodemanager from the yarn cluster cleanly

2019-08-05 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9721: --- Description: If we want to take offline a nodemanager server, nodes.exclude-path and "rmadmin -refreshNodes"

[jira] [Created] (YARN-9721) An easy method to exclude a nodemanager from the yarn cluster cleanly

2019-08-05 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9721: -- Summary: An easy method to exclude a nodemanager from the yarn cluster cleanly Key: YARN-9721 URL: https://issues.apache.org/jira/browse/YARN-9721 Project: Hadoop YARN

[jira] [Commented] (YARN-9447) RM Crashes with NPE at TimelineServiceV2Publisher.putEntity

2019-04-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16817505#comment-16817505 ] Zac Zhou commented on YARN-9447: [~Prabhu Joseph], Thanks for fixing it. I think this issue is the same

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-04 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759785#comment-16759785 ] Zac Zhou commented on YARN-9161: The new failed case seems not related to this patch. I run the test case

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-03 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16759404#comment-16759404 ] Zac Zhou commented on YARN-9161: Since [YARN-9262|https://issues.apache.org/jira/browse/YARN-9262] fix the

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-03 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.012.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-02 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.011.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Comment Edited] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-02 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758973#comment-16758973 ] Zac Zhou edited comment on YARN-9161 at 2/2/19 11:59 AM: - For the failed test

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-02 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758973#comment-16758973 ] Zac Zhou commented on YARN-9161: For the failed test cases of TestRMAppAttemptTransitions, it seems

[jira] [Comment Edited] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-02 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758973#comment-16758973 ] Zac Zhou edited comment on YARN-9161 at 2/2/19 11:56 AM: - For the failed test

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-02-01 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16758113#comment-16758113 ] Zac Zhou commented on YARN-9161: Thanks, [~sunilg] Yeah. For the latest patch, I just changed the 

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-31 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.010.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-31 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16757911#comment-16757911 ] Zac Zhou commented on YARN-9161: Thank you [~sunilg] for triggering Jenkins. Distributedshell is ok now

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-28 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754599#comment-16754599 ] Zac Zhou commented on YARN-9161: YARN-9161.009.patch is to fix some checkstyle and findbugs issues. I run 

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-28 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.009.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-9231) TestDistributedShell fix timeout

2019-01-27 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753696#comment-16753696 ] Zac Zhou commented on YARN-9231: [~Prabhu Joseph] , I run into the same problem. Thanks a lot for fixing

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-27 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.008.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-25 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.007.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751938#comment-16751938 ] Zac Zhou commented on YARN-9161: There are some code conflicts with 

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16751934#comment-16751934 ] Zac Zhou commented on YARN-9161: [~sunilg], Thanks a lot for your comments~ {quote}I have some doubts

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-22 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749522#comment-16749522 ] Zac Zhou commented on YARN-9161: [~sunilg] , Thanks a lot for your comments. Checked with [~tangzhankun]

[jira] [Commented] (YARN-6695) Race condition in RM for publishing container events vs appFinished events causes NPE

2019-01-22 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749497#comment-16749497 ] Zac Zhou commented on YARN-6695: I checked the logic for TimelineServiceV2Publisher. If 

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-22 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749498#comment-16749498 ] Zac Zhou commented on YARN-9161: [~sunilg], [~leftnoteasy], [~tangzhankun]  welcome to add some comments

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-21 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748468#comment-16748468 ] Zac Zhou commented on YARN-9161: I tested the TestCapacitySchedulerSurgicalPreemption locally, it doesn't

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-17 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745779#comment-16745779 ] Zac Zhou commented on YARN-9161: Update patch to fix failed UT cases > Absolute resources of capacity

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-17 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.006.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-17 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745759#comment-16745759 ] Zac Zhou commented on YARN-9205: [~tangzhankun] {quote}private static Map

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-16 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16744183#comment-16744183 ] Zac Zhou commented on YARN-9161: Add UT for container allocation and fix some code style issues >

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-16 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.005.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-16 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.004.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2019-01-10 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16739331#comment-16739331 ] Zac Zhou commented on YARN-8489: [~leftnoteasy], [~suma.shivaprasad] When you get spare time, can you

[jira] [Comment Edited] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-09 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16738921#comment-16738921 ] Zac Zhou edited comment on YARN-9161 at 1/10/19 2:36 AM: - The test case is broken

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-09 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16738921#comment-16738921 ] Zac Zhou commented on YARN-9161: The test case is broken by 

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-09 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16738327#comment-16738327 ] Zac Zhou commented on YARN-9161: [~sunilg], Thanks for your comments~ The failed unit tests seem not

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.003.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-9185) TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737830#comment-16737830 ] Zac Zhou commented on YARN-9185: [~eyang] Thanks a lot for fixing it~ > TimelineServiceV2Publisher

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737791#comment-16737791 ] Zac Zhou commented on YARN-8489: [~suma.shivaprasad] Thanks a lot for your comments~ > Need to support

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8489: --- Attachment: YARN-8489.005.patch > Need to support "dominant" component concept inside YARN service >

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8489: --- Attachment: YARN-8489.004.patch > Need to support "dominant" component concept inside YARN service >

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737084#comment-16737084 ] Zac Zhou commented on YARN-8489: [~leftnoteasy], [~suma.shivaprasad] Thanks a lot for your comments.

[jira] [Commented] (YARN-9185) TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16737091#comment-16737091 ] Zac Zhou commented on YARN-9185: When the following configuration is specified:

[jira] [Updated] (YARN-9185) TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated

2019-01-08 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9185: --- Issue Type: Sub-task (was: Bug) Parent: YARN-8489 > TimelineServiceV2Publisher throws NPE when app

[jira] [Created] (YARN-9185) TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated

2019-01-08 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9185: -- Summary: TimelineServiceV2Publisher throws NPE when app is finished before container metrics updated Key: YARN-9185 URL: https://issues.apache.org/jira/browse/YARN-9185 Project:

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-07 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.002.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-9155) Can't re-run a submarine job, if the previous job with the same service name has finished

2019-01-07 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16735602#comment-16735602 ] Zac Zhou commented on YARN-9155: [~leftnoteasy], Thanks a lot for your comments. it makes sense to me.

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-02 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732613#comment-16732613 ] Zac Zhou commented on YARN-9161: Thanks a lot, [~leftnoteasy], [~sunilg] {code:java} // W/o unit for

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-02 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732006#comment-16732006 ] Zac Zhou commented on YARN-9161: I checked the failed test case TestRunJobCliParsing and found that it's

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2018-12-31 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: (was: YARN-9161.001.patch) > Absolute resources of capacity scheduler doesn't support GPU and

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2018-12-31 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.001.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Created] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2018-12-28 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9161: -- Summary: Absolute resources of capacity scheduler doesn't support GPU and FPGA Key: YARN-9161 URL: https://issues.apache.org/jira/browse/YARN-9161 Project: Hadoop YARN

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2018-12-28 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730541#comment-16730541 ] Zac Zhou commented on YARN-9161: a patch would be attached shortly. > Absolute resources of capacity

[jira] [Commented] (YARN-9003) Support multi-homed network for docker container

2018-12-26 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728938#comment-16728938 ] Zac Zhou commented on YARN-9003: I'm not sure whether --net can specify multiple networks.  I tried 

[jira] [Commented] (YARN-9155) Can't re-run a submarine job, if the previous job with the same service name has finished

2018-12-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728293#comment-16728293 ] Zac Zhou commented on YARN-9155: Or should we add an after service listeners interface to yarn native

[jira] [Updated] (YARN-9155) Can't re-run a submarine job, if a previous job with the same service name has finished

2018-12-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9155: --- Summary: Can't re-run a submarine job, if a previous job with the same service name has finished (was: Can't

[jira] [Updated] (YARN-9155) Can't re-run a submarine job, if the previous job with the same service name has finished

2018-12-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9155: --- Summary: Can't re-run a submarine job, if the previous job with the same service name has finished (was:

[jira] [Commented] (YARN-9155) Can't submit a submarine job, if a previous job with the same service name has finished

2018-12-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16728276#comment-16728276 ] Zac Zhou commented on YARN-9155: Could we add a parameter in Service API to indicate that the service

[jira] [Created] (YARN-9155) Can't submit a submarine job, if a previous job with the same service name has finished

2018-12-24 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9155: -- Summary: Can't submit a submarine job, if a previous job with the same service name has finished Key: YARN-9155 URL: https://issues.apache.org/jira/browse/YARN-9155 Project:

[jira] [Commented] (YARN-9144) WebAppProxyServlet can't redirect to ATS V1.5 when a yarn native service app is finished

2018-12-18 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16724723#comment-16724723 ] Zac Zhou commented on YARN-9144: Fix code stype > WebAppProxyServlet can't redirect to ATS V1.5 when a

[jira] [Updated] (YARN-9144) WebAppProxyServlet can't redirect to ATS V1.5 when a yarn native service app is finished

2018-12-18 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9144: --- Attachment: YARN-9144.002.patch > WebAppProxyServlet can't redirect to ATS V1.5 when a yarn native service

[jira] [Created] (YARN-9144) WebAppProxyServlet can't redirect to ATS V1.5 when a yarn native service app is finished

2018-12-18 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9144: -- Summary: WebAppProxyServlet can't redirect to ATS V1.5 when a yarn native service app is finished Key: YARN-9144 URL: https://issues.apache.org/jira/browse/YARN-9144 Project:

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-12-17 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722923#comment-16722923 ] Zac Zhou commented on YARN-8489: [~suma.shivaprasad] , Thanks a lot. The failed test case seems not

[jira] [Updated] (YARN-9141) [submarine] JobStatus outputs with system UTC clock, not local clock

2018-12-16 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9141: --- Description: The current time is Mon Dec 17 12:26:31 CST 2018. But submarine job status output is like this:

[jira] [Created] (YARN-9141) [submarine] JobStatus outputs with system UTC clock, not local clock

2018-12-16 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9141: -- Summary: [submarine] JobStatus outputs with system UTC clock, not local clock Key: YARN-9141 URL: https://issues.apache.org/jira/browse/YARN-9141 Project: Hadoop YARN

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-12-16 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8489: --- Attachment: YARN-8489.003.patch > Need to support "dominant" component concept inside YARN service >

[jira] [Updated] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-12-15 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8489: --- Attachment: YARN-8489.002.patch > Need to support "dominant" component concept inside YARN service >

[jira] [Commented] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-12-11 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16716694#comment-16716694 ] Zac Zhou commented on YARN-8489: @[~suma.shivaprasad] any Updates? Or would you mind if I take it, as this

[jira] [Comment Edited] (YARN-8489) Need to support "dominant" component concept inside YARN service

2018-12-11 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16716694#comment-16716694 ] Zac Zhou edited comment on YARN-8489 at 12/11/18 9:47 AM: -- [~suma.shivaprasad] 

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-12-04 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708652#comment-16708652 ] Zac Zhou commented on YARN-8960: I think it should be ok, [~leftnoteasy] any comments? > [Submarine]

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-12-04 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708649#comment-16708649 ] Zac Zhou commented on YARN-9001: Yup, I think it can be applied to 3.2.0. Since this patch uses API from

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Attachment: YARN-8960.007.patch > [Submarine] Can't get submarine service status using the command of "yarn

[jira] [Comment Edited] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687457#comment-16687457 ] Zac Zhou edited comment on YARN-8960 at 11/15/18 4:18 AM: -- Add a parameter, named 

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687457#comment-16687457 ] Zac Zhou commented on YARN-8960: Add a parameter, named distribute_keytab, which can be used to specify

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Attachment: YARN-8960.006.patch > [Submarine] Can't get submarine service status using the command of "yarn

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Attachment: YARN-8960.006.patch > [Submarine] Can't get submarine service status using the command of "yarn

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Attachment: (was: YARN-8960.006.patch) > [Submarine] Can't get submarine service status using the command

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686692#comment-16686692 ] Zac Zhou commented on YARN-8960:   Thanks,[~leftnoteasy] For comment 1 {quote}1) doLoginIfSecure, could

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-14 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Attachment: YARN-8960.005.patch > [Submarine] Can't get submarine service status using the command of "yarn

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-13 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686076#comment-16686076 ] Zac Zhou commented on YARN-9001: Thanks, [~leftnoteasy] I checked the code and found there were no

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-13 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9001: --- Attachment: YARN-9001-branch-3.2.001.patch > [Submarine] Use AppAdminClient instead of ServiceClient to

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-13 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Attachment: YARN-8960.004.patch > [Submarine] Can't get submarine service status using the command of "yarn

[jira] [Comment Edited] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684788#comment-16684788 ] Zac Zhou edited comment on YARN-8960 at 11/13/18 6:53 AM: -- As discussion offline,

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684788#comment-16684788 ] Zac Zhou commented on YARN-8960: As discussion offline, we can use the same kerberos keytab parameter for

[jira] [Comment Edited] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684788#comment-16684788 ] Zac Zhou edited comment on YARN-8960 at 11/13/18 6:50 AM: -- As discussion offline,

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684664#comment-16684664 ] Zac Zhou edited comment on YARN-8714 at 11/13/18 3:14 AM: -- Looks great, it would

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684664#comment-16684664 ] Zac Zhou edited comment on YARN-8714 at 11/13/18 3:14 AM: -- Looks great, it would

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684664#comment-16684664 ] Zac Zhou edited comment on YARN-8714 at 11/13/18 3:13 AM: -- Looks great, it would

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684664#comment-16684664 ] Zac Zhou commented on YARN-8714: Looks great, it would be convenient for notebook app, like Zeppline, to

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684639#comment-16684639 ] Zac Zhou commented on YARN-9001: Sure, Wangda The following test cases have been executed: # submarine

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16683661#comment-16683661 ] Zac Zhou commented on YARN-9001: The ut error seems is not related to the patch, resubmit the patch >

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-12 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9001: --- Attachment: YARN-9001.004.patch > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs >

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-11 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9001: --- Attachment: YARN-9001.003.patch > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs >

[jira] [Commented] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-10 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682419#comment-16682419 ] Zac Zhou commented on YARN-8960: Maybe, we need both of them, To enable "yarn app -status", submarine

[jira] [Updated] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-10 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9001: --- Attachment: YARN-9001.002.patch > [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs >

[jira] [Commented] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-09 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681388#comment-16681388 ] Zac Zhou commented on YARN-9001: I'll submit a patch shortly > [Submarine] Use AppAdminClient instead of

[jira] [Created] (YARN-9001) [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs

2018-11-09 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-9001: -- Summary: [Submarine] Use AppAdminClient instead of ServiceClient to sumbit jobs Key: YARN-9001 URL: https://issues.apache.org/jira/browse/YARN-9001 Project: Hadoop YARN

[jira] [Updated] (YARN-8960) [Submarine] Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-01 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Summary: [Submarine] Can't get submarine service status using the command of "yarn app -status" under

[jira] [Updated] (YARN-8960) {Submarine} Can't get submarine service status using the command of "yarn app -status" under security environment

2018-11-01 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Summary: {Submarine} Can't get submarine service status using the command of "yarn app -status" under

  1   2   >