[jira] [Assigned] (YARN-7271) Add a yarn application cost calculation framework in TimelineService v2

2019-01-28 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks reassigned YARN-7271: --- Assignee: Sushil Ks > Add a yarn application cost calculation framework in TimelineService v2 >

[jira] [Assigned] (YARN-6095) create a REST API that returns the clusters for a given app id

2019-01-28 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks reassigned YARN-6095: --- Assignee: Sushil Ks > create a REST API that returns the clusters for a given app id >

[jira] [Commented] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

2019-01-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754677#comment-16754677 ] Hudson commented on YARN-9086: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15844 (See

[jira] [Commented] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

2019-01-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754661#comment-16754661 ] Weiwei Yang commented on YARN-9086: --- Thanks [~sunilg], committing the patch now. > [CSI] Run

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Attachment: YARN-8821-trunk.003.patch > GPU hierarchy/topology scheduling support >

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Attachment: YARN-8821-trunk.002.patch > GPU hierarchy/topology scheduling support >

[jira] [Commented] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

2019-01-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754618#comment-16754618 ] Hadoop QA commented on YARN-9086: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754613#comment-16754613 ] Jiandan Yang commented on YARN-9247: - test failed due to *'protoc --version' did not return a version

[jira] [Comment Edited] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754592#comment-16754592 ] Zhankun Tang edited comment on YARN-8821 at 1/29/19 4:43 AM: - [~leftnoteasy] ,

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-28 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754599#comment-16754599 ] Zac Zhou commented on YARN-9161: YARN-9161.009.patch is to fix some checkstyle and findbugs issues. I run 

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: GPU topology affects performance dramatically. There's been a discussion in YARN-7481.

[jira] [Comment Edited] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754592#comment-16754592 ] Zhankun Tang edited comment on YARN-8821 at 1/29/19 4:41 AM: - [~leftnoteasy] ,

[jira] [Commented] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754592#comment-16754592 ] Zhankun Tang commented on YARN-8821: [~leftnoteasy] , [~cheersyang] , [~sunilg] . Please help to

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: GPU topology affects performance dramatically. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: GPU topology affects performance dramatically. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: GPU topology affects performance dramatically. There's been a discussion in YARN-7481.

[jira] [Commented] (YARN-9099) GpuResourceAllocator.getReleasingGpus calculates number of GPUs in a wrong way

2019-01-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754589#comment-16754589 ] Sunil Govindan commented on YARN-9099: -- +1. Lets get this in. Committing shortly if no objections.

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: GPU topology affects performance dramatically. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: GPU topology affects performance dramatically. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: GPU topology affects performance dramatically. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: GPU topology affects performance dramatically. There's been a discussion in YARN-7481.

[jira] [Commented] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

2019-01-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754585#comment-16754585 ] Sunil Govindan commented on YARN-9086: -- +1 to latest patch. pending jenkins. > [CSI] Run

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Description: GPU topology affects performance dramatically. There's been a discussion in YARN-7481.

[jira] [Updated] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

2019-01-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9086: -- Attachment: YARN-9086.004.patch > [CSI] Run csi-driver-adaptor as aux service >

[jira] [Commented] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

2019-01-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754582#comment-16754582 ] Weiwei Yang commented on YARN-9086: --- Hi [~sunilg] Thanks for the comments. Pls see my response below

[jira] [Commented] (YARN-9099) GpuResourceAllocator.getReleasingGpus calculates number of GPUs in a wrong way

2019-01-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754568#comment-16754568 ] Zhankun Tang commented on YARN-9099: [~pbacsko], [~snemeth] . Since it's a quite straight forward fix.

[jira] [Commented] (YARN-9086) [CSI] Run csi-driver-adaptor as aux service

2019-01-28 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754567#comment-16754567 ] Sunil Govindan commented on YARN-9086: -- Hi [~cheersyang] Thanks for the work. Some comments 1.

[jira] [Commented] (YARN-4586) YARN ATS: ATS leveldb fails to come up

2019-01-28 Thread Rakesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754549#comment-16754549 ] Rakesh Shah commented on YARN-4586: --- [~bingoogle] It may be configuration issue of timeline store path

[jira] [Commented] (YARN-9237) NM should ignore sending finished apps to RM during RM fail-over

2019-01-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754544#comment-16754544 ] Weiwei Yang commented on YARN-9237: --- Just committed to all 3.x streams, [~yangjiandan], thanks for the

[jira] [Commented] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754540#comment-16754540 ] Hadoop QA commented on YARN-9247: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9237) NM should ignore sending finished apps to RM during RM fail-over

2019-01-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754539#comment-16754539 ] Hudson commented on YARN-9237: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15842 (See

[jira] [Updated] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9247: Attachment: YARN-9247.branch-2.7.2.001.patch > NM fails to start when downgrading from 3.x to 2.7 >

[jira] [Commented] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754526#comment-16754526 ] Weiwei Yang commented on YARN-9209: --- Hi [~leftnoteasy] I agree with your reasoning about not to support

[jira] [Updated] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9247: Affects Version/s: 2.7.2 > NM fails to start when downgrading from 3.x to 2.7 >

[jira] [Updated] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9247: Description: NM will throws *java.io.IOException: Unexpected container state key* when downgrading

[jira] [Commented] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754511#comment-16754511 ] Jiandan Yang commented on YARN-9247: - Although a low version compatible for a high version is not

[jira] [Updated] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-9247: Description: NM will throws *java.io.IOException: Unexpected container state key* when downgrading

[jira] [Created] (YARN-9247) NM fails to start when downgrading from 3.x to 2.7

2019-01-28 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-9247: --- Summary: NM fails to start when downgrading from 3.x to 2.7 Key: YARN-9247 URL: https://issues.apache.org/jira/browse/YARN-9247 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8901) Restart "NEVER" policy does not work with component dependency

2019-01-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754447#comment-16754447 ] Hudson commented on YARN-8901: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15841 (See

[jira] [Commented] (YARN-9074) Docker container rm command should be executed after stop

2019-01-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1675#comment-1675 ] Hudson commented on YARN-9074: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15840 (See

[jira] [Commented] (YARN-8901) Restart "NEVER" policy does not work with component dependency

2019-01-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754433#comment-16754433 ] Eric Yang commented on YARN-8901: - +1 looks good to me. > Restart "NEVER" policy does not work with

[jira] [Created] (YARN-9246) NPE when executing a command yarn node -status or -states without additional arguments

2019-01-28 Thread Masahiro Tanaka (JIRA)
Masahiro Tanaka created YARN-9246: - Summary: NPE when executing a command yarn node -status or -states without additional arguments Key: YARN-9246 URL: https://issues.apache.org/jira/browse/YARN-9246

[jira] [Commented] (YARN-8498) Yarn NodeManager OOM Listener Fails Compilation on Ubuntu 18.04

2019-01-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754421#comment-16754421 ] Hadoop QA commented on YARN-8498: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9074) Docker container rm command should be executed after stop

2019-01-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754400#comment-16754400 ] Eric Yang commented on YARN-9074: - +1 for patch 003. The failed unit test TestFederationInterceptor does

[jira] [Commented] (YARN-9191) Add cli option in DS to support enforceExecutionType in resource requests.

2019-01-28 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-9191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754363#comment-16754363 ] Íñigo Goiri commented on YARN-9191: --- {code} One getAppAttempt is done after containers are running to

[jira] [Resolved] (YARN-9240) YARN UI 2 footer shows the datetime in different timezone

2019-01-28 Thread Masahiro Tanaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masahiro Tanaka resolved YARN-9240. --- Resolution: Duplicate > YARN UI 2 footer shows the datetime in different timezone >

[jira] [Commented] (YARN-9240) YARN UI 2 footer shows the datetime in different timezone

2019-01-28 Thread Masahiro Tanaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754331#comment-16754331 ] Masahiro Tanaka commented on YARN-9240: --- I just noticed that this issue was a duplicate of YARN-8747

[jira] [Created] (YARN-9245) Add support to find out when a docker image pull is complete

2019-01-28 Thread Chandni Singh (JIRA)
Chandni Singh created YARN-9245: --- Summary: Add support to find out when a docker image pull is complete Key: YARN-9245 URL: https://issues.apache.org/jira/browse/YARN-9245 Project: Hadoop YARN

[jira] [Created] (YARN-9244) Document docker registry deployment with direct S3 driver

2019-01-28 Thread Eric Yang (JIRA)
Eric Yang created YARN-9244: --- Summary: Document docker registry deployment with direct S3 driver Key: YARN-9244 URL: https://issues.apache.org/jira/browse/YARN-9244 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8901) Restart "NEVER" policy does not work with component dependency

2019-01-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754276#comment-16754276 ] Hadoop QA commented on YARN-8901: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9240) YARN UI 2 footer shows the datetime in different timezone

2019-01-28 Thread Masahiro Tanaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754264#comment-16754264 ] Masahiro Tanaka commented on YARN-9240: --- [~sunilg] Thanks for watching this. As I guess this is a

[jira] [Commented] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754249#comment-16754249 ] Wangda Tan commented on YARN-9209: -- [~tarunparimi], [~cheersyang], Actually, this is by design.

[jira] [Commented] (YARN-7824) [UI2] Yarn Component Instance page should include link to container logs

2019-01-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754217#comment-16754217 ] Hadoop QA commented on YARN-7824: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9191) Add cli option in DS to support enforceExecutionType in resource requests.

2019-01-28 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754209#comment-16754209 ] Abhishek Modi commented on YARN-9191: - Thanks [~elgoiri] for review: Why do we do getAppAttempts() in

[jira] [Updated] (YARN-8901) Restart "NEVER" policy does not work with component dependency

2019-01-28 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8901: --- Attachment: (was: YARN-8901.3.patch) > Restart "NEVER" policy does not work with

[jira] [Comment Edited] (YARN-8901) Restart "NEVER" policy does not work with component dependency

2019-01-28 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754194#comment-16754194 ] Suma Shivaprasad edited comment on YARN-8901 at 1/28/19 6:00 PM: - Attached

[jira] [Commented] (YARN-8901) Restart "NEVER" policy does not work with component dependency

2019-01-28 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754194#comment-16754194 ] Suma Shivaprasad commented on YARN-8901: Attached patch which fixes checking for succeeded >

[jira] [Updated] (YARN-8901) Restart "NEVER" policy does not work with component dependency

2019-01-28 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8901: --- Attachment: YARN-8901.3.patch > Restart "NEVER" policy does not work with component

[jira] [Updated] (YARN-8901) Restart "NEVER" policy does not work with component dependency

2019-01-28 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8901: --- Attachment: YARN-8901.3.patch > Restart "NEVER" policy does not work with component

[jira] [Commented] (YARN-9074) Docker container rm command should be executed after stop

2019-01-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754179#comment-16754179 ] Hadoop QA commented on YARN-9074: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9191) Add cli option in DS to support enforceExecutionType in resource requests.

2019-01-28 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-9191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754170#comment-16754170 ] Íñigo Goiri commented on YARN-9191: --- Thanks [~abmodi] for [^YARN-9191.004.patch]. * Why do we do

[jira] [Updated] (YARN-7824) [UI2] Yarn Component Instance page should include link to container logs

2019-01-28 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-7824: --- Attachment: YARN-7824.001.patch > [UI2] Yarn Component Instance page should include link to container logs >

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754161#comment-16754161 ] Eric Payne commented on YARN-6616: -- bq. I see that there is no unit test added for the correction in

[jira] [Updated] (YARN-9074) Docker container rm command should be executed after stop

2019-01-28 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9074: -- Attachment: YARN-9074.003.patch > Docker container rm command should be executed after stop >

[jira] [Commented] (YARN-9074) Docker container rm command should be executed after stop

2019-01-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754083#comment-16754083 ] Hadoop QA commented on YARN-9074: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-01-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754065#comment-16754065 ] Hadoop QA commented on YARN-9224: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754067#comment-16754067 ] Eric Payne commented on YARN-6616: -- [~Prabhu Joseph]. Thanks for the branch-2.8 and branch-2.7 patches.

[jira] [Commented] (YARN-9237) NM should ignore sending finished apps to RM during RM fail-over

2019-01-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754057#comment-16754057 ] Weiwei Yang commented on YARN-9237: --- Alright, since the change is pretty straightforwad, I think that's

[jira] [Commented] (YARN-9237) NM should ignore sending finished apps to RM during RM fail-over

2019-01-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754058#comment-16754058 ] Weiwei Yang commented on YARN-9237: --- Looks like there are some issue with gitbox right now :( I will

[jira] [Commented] (YARN-7018) Interface for adding extra behavior to node heartbeats

2019-01-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754054#comment-16754054 ] Weiwei Yang commented on YARN-7018: --- Hi [~maniraj...@gmail.com], could you add some more background or

[jira] [Commented] (YARN-9238) We get a wrong attempt by an appAttemptId when AM crash at some point

2019-01-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754039#comment-16754039 ] Weiwei Yang commented on YARN-9238: --- Hi [~xiaoheipangzi] This looks like similar to YARN-6959. Fix

[jira] [Commented] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-01-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754047#comment-16754047 ] Hadoop QA commented on YARN-9184: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9074) Docker container rm command should be executed after stop

2019-01-28 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754044#comment-16754044 ] Zhaohui Xin commented on YARN-9074: --- [~shaneku...@gmail.com], Thanks for your suggestions. I attached

[jira] [Updated] (YARN-9074) Docker container rm command should be executed after stop

2019-01-28 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9074: -- Attachment: YARN-9074.002.patch > Docker container rm command should be executed after stop >

[jira] [Commented] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-01-28 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754031#comment-16754031 ] Tarun Parimi commented on YARN-9224: Attaching a new patch, since I missed handling client.close() in

[jira] [Updated] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-01-28 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9224: --- Attachment: YARN-9224.002.patch > TimelineDelegationTokenIdentifier.Renewer contacts KDC for every

[jira] [Commented] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-01-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16754026#comment-16754026 ] Hadoop QA commented on YARN-9224: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753979#comment-16753979 ] Hadoop QA commented on YARN-9161: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9224) TimelineDelegationTokenIdentifier.Renewer contacts KDC for every renew/cancel token operation

2019-01-28 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9224: --- Attachment: YARN-9224.001.patch > TimelineDelegationTokenIdentifier.Renewer contacts KDC for every

[jira] [Commented] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-01-28 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753963#comment-16753963 ] Zhaohui Xin commented on YARN-9184: --- Thanks for your reviewing, [~ebadger]. I attached new patch. :D >

[jira] [Updated] (YARN-9184) Docker run doesn't pull down latest image if the image exists locally

2019-01-28 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin updated YARN-9184: -- Attachment: YARN-9184.004.patch > Docker run doesn't pull down latest image if the image exists locally

[jira] [Commented] (YARN-9233) RM may report allocated container which is killed (but not acquired by AM ) to AM which can cause spark AM confused

2019-01-28 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753884#comment-16753884 ] Bilwa S T commented on YARN-9233: - Thanks [~bibinchundatt] for suggestion. I think it can be achieved in

[jira] [Updated] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-28 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-9161: --- Attachment: YARN-9161.009.patch > Absolute resources of capacity scheduler doesn't support GPU and FPGA >

[jira] [Commented] (YARN-9243) Support limiting network outbound bandwidth for multiple interfaces

2019-01-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753809#comment-16753809 ] Hadoop QA commented on YARN-9243: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753762#comment-16753762 ] Hadoop QA commented on YARN-9161: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||