[jira] [Updated] (YARN-7050) Post cleanup after YARN-6903

2017-08-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7050: -- Attachment: YARN-7050.yarn-native-services.06.patch > Post cleanup after YARN-6903 >

[jira] [Updated] (YARN-7050) Post cleanup after YARN-6903

2017-08-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7050: -- Attachment: (was: YARN-7050.yarn-native-services.06.patch) > Post cleanup after YARN-6903 >

[jira] [Updated] (YARN-7050) Post cleanup after YARN-6903

2017-08-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7050: -- Attachment: (was: YARN-7050.yarn-native-services.06.patch) > Post cleanup after YARN-6903 >

[jira] [Updated] (YARN-7050) Post cleanup after YARN-6903

2017-08-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7050: -- Attachment: YARN-7050.yarn-native-services.06.patch > Post cleanup after YARN-6903 >

[jira] [Updated] (YARN-7050) Post cleanup after YARN-6903

2017-08-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7050: -- Attachment: YARN-7050.yarn-native-services.06.patch Latest patch added some logic changes in ServiceClient. >

[jira] [Commented] (YARN-5603) Metrics for Federation StateStore

2017-08-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136333#comment-16136333 ] Arun Suresh commented on YARN-5603: --- Apologize for the delay in reviews [~ellenfkh]. +1. Thanks for the

[jira] [Resolved] (YARN-3053) [Security] Review and implement authentication in ATS v.2

2017-08-21 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C resolved YARN-3053. -- Resolution: Fixed Hadoop Flags: Reviewed Target Version/s: YARN-5355 Resolving this

[jira] [Updated] (YARN-6933) ResourceUtils.DISALLOWED_NAMES and ResourceUtils.checkMandatoryResources() are duplicating work

2017-08-21 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6933: --- Attachment: YARN-6933-YARN-3926.006.patch > ResourceUtils.DISALLOWED_NAMES and

[jira] [Commented] (YARN-6933) ResourceUtils.DISALLOWED_NAMES and ResourceUtils.checkMandatoryResources() are duplicating work

2017-08-21 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136309#comment-16136309 ] Manikandan R commented on YARN-6933: Rebasing patch. > ResourceUtils.DISALLOWED_NAMES and

[jira] [Updated] (YARN-7068) Documentation updates for branch2 Timeline Service V2

2017-08-21 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7068: - Parent Issue: YARN-7055 (was: YARN-7063) > Documentation updates for branch2 Timeline Service V2 >

[jira] [Updated] (YARN-6523) RM requires large memory in sending out security tokens as part of Node Heartbeat in large cluster

2017-08-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6523: Issue Type: Improvement (was: Bug) > RM requires large memory in sending out security

[jira] [Commented] (YARN-6523) RM requires large memory in sending out security tokens as part of Node Heartbeat in large cluster

2017-08-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136281#comment-16136281 ] Naganarasimha G R commented on YARN-6523: - Thanks [~rchiang], for having a look into this, as per

[jira] [Updated] (YARN-6523) RM requires large memory in sending out security tokens as part of Node Heartbeat in large cluster

2017-08-21 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6523: Target Version/s: 2.9.0 (was: 2.9.0, 3.0.0-beta1) > RM requires large memory in sending out

[jira] [Updated] (YARN-7067) Optimize resource type info shown in UI

2017-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7067: - Attachment: YARN-7067.YARN-3926.001.patch > Optimize resource type info shown in UI >

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136227#comment-16136227 ] Hadoop QA commented on YARN-7009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7068) Documentation updates for branch2 Timeline Service V2

2017-08-21 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7068: - Issue Type: Sub-task (was: Bug) Parent: YARN-7063 > Documentation updates for branch2 Timeline

[jira] [Created] (YARN-7068) Documentation updates for branch2 Timeline Service V2

2017-08-21 Thread Vrushali C (JIRA)
Vrushali C created YARN-7068: Summary: Documentation updates for branch2 Timeline Service V2 Key: YARN-7068 URL: https://issues.apache.org/jira/browse/YARN-7068 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-6047) Documentation updates for TimelineService v2

2017-08-21 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136219#comment-16136219 ] Vrushali C commented on YARN-6047: -- The patches 005 or 004 do not apply cleanly to YARN-5355_branch2.

[jira] [Commented] (YARN-6047) Documentation updates for TimelineService v2

2017-08-21 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136215#comment-16136215 ] Vrushali C commented on YARN-6047: -- Committed to YARN-5355 as part of

[jira] [Commented] (YARN-6047) Documentation updates for TimelineService v2

2017-08-21 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136209#comment-16136209 ] Vrushali C commented on YARN-6047: -- Committing patch 005 now > Documentation updates for TimelineService

[jira] [Commented] (YARN-3661) Basic Federation UI

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136197#comment-16136197 ] Hadoop QA commented on YARN-3661: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7053) Move curator transaction support to ZKCuratorManager

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136190#comment-16136190 ] Hadoop QA commented on YARN-7053: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7067) Optimize resource type info shown in UI

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136187#comment-16136187 ] Hadoop QA commented on YARN-7067: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-08-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136185#comment-16136185 ] Eric Yang commented on YARN-7066: - [~miklos.szeg...@cloudera.com] Correct. Updated title accordingly. >

[jira] [Comment Edited] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-08-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136185#comment-16136185 ] Eric Yang edited comment on YARN-7066 at 8/22/17 2:47 AM: --

[jira] [Updated] (YARN-7066) Add ability to specify volumes to mount for DockerContainerRuntime

2017-08-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7066: Summary: Add ability to specify volumes to mount for DockerContainerRuntime (was: Add ability to specify

[jira] [Commented] (YARN-7050) Post cleanup after YARN-6903

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136159#comment-16136159 ] Hadoop QA commented on YARN-7050: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6911) Graph application-level resource utilization in Web UI v2

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136155#comment-16136155 ] Hadoop QA commented on YARN-6911: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136151#comment-16136151 ] Hadoop QA commented on YARN-7064: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7049) FSAppAttempt preemption related fields have confusing names

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136138#comment-16136138 ] Hadoop QA commented on YARN-7049: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-3661) Basic Federation UI

2017-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-3661: -- Attachment: YARN-3661-002.patch > Basic Federation UI > > > Key:

[jira] [Updated] (YARN-7067) Optimize resource type info shown in UI

2017-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7067: - Attachment: YARN-7067.001.patch Attached ver.1 patch, now the format looks like: {code}

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-08-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.002.patch > TestNMClient.testNMClientNoCleanupOnStop is flaky by design >

[jira] [Updated] (YARN-7062) yarn job args changed by ContainerLaunch.expandEnvironment(), such as "{{" and "}}"

2017-08-21 Thread Lingfeng Su (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingfeng Su updated YARN-7062: -- Issue Type: Bug (was: Improvement) > yarn job args changed by ContainerLaunch.expandEnvironment(), such

[jira] [Updated] (YARN-7013) merge related work for YARN-3926 branch

2017-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7013: - Attachment: YARN-7013.003.patch Attached ver.3 patch. include latest changes. > merge related work for

[jira] [Commented] (YARN-6127) Add support for work preserving NM restart when AMRMProxy is enabled

2017-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136099#comment-16136099 ] Karthik Kambatla commented on YARN-6127: Given this breaks rolling upgrade, are we sure we want to

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136096#comment-16136096 ] Hadoop QA commented on YARN-7009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6047) Documentation updates for TimelineService v2

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136094#comment-16136094 ] Hadoop QA commented on YARN-6047: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6911) Graph application-level resource utilization in Web UI v2

2017-08-21 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Yousufi updated YARN-6911: --- Attachment: YARN-6911.001.patch > Graph application-level resource utilization in Web UI v2 >

[jira] [Created] (YARN-7067) Optimize resource type info shown in UI

2017-08-21 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-7067: Summary: Optimize resource type info shown in UI Key: YARN-7067 URL: https://issues.apache.org/jira/browse/YARN-7067 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-3661) Basic Federation UI

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136079#comment-16136079 ] Hadoop QA commented on YARN-3661: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2162) add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

2017-08-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136024#comment-16136024 ] ASF GitHub Bot commented on YARN-2162: -- Github user flyrain commented on a diff in the pull request:

[jira] [Commented] (YARN-2162) add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

2017-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136023#comment-16136023 ] Wangda Tan commented on YARN-2162: -- Just curious to ask since we're working on YARN-5881. What is your

[jira] [Commented] (YARN-7053) Move curator transaction support to ZKCuratorManager

2017-08-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136021#comment-16136021 ] Subru Krishnan commented on YARN-7053: -- [~jhung], thanks for adding the test. Can you add a *setData*

[jira] [Commented] (YARN-2162) add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

2017-08-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136019#comment-16136019 ] ASF GitHub Bot commented on YARN-2162: -- Github user flyrain commented on a diff in the pull request:

[jira] [Commented] (YARN-7066) Add ability to specify volumes to mount for DockerContainerExecutor

2017-08-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136018#comment-16136018 ] Miklos Szegedi commented on YARN-7066: -- [~eyang], do you mean DockerContainerRuntime?

[jira] [Commented] (YARN-6251) Add support for async Container release to prevent deadlock during container updates

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136008#comment-16136008 ] Hadoop QA commented on YARN-6251: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2162) add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

2017-08-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136003#comment-16136003 ] ASF GitHub Bot commented on YARN-2162: -- Github user flyrain commented on a diff in the pull request:

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2017-08-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.001.patch > Use cgroup to get container resource utilization >

[jira] [Commented] (YARN-2162) add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

2017-08-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135998#comment-16135998 ] ASF GitHub Bot commented on YARN-2162: -- Github user flyrain commented on a diff in the pull request:

[jira] [Commented] (YARN-2162) add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

2017-08-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135990#comment-16135990 ] ASF GitHub Bot commented on YARN-2162: -- Github user flyrain commented on a diff in the pull request:

[jira] [Updated] (YARN-7050) Post cleanup after YARN-6903

2017-08-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7050: -- Attachment: YARN-7050.yarn-native-services.05.patch > Post cleanup after YARN-6903 >

[jira] [Commented] (YARN-2162) add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

2017-08-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135986#comment-16135986 ] ASF GitHub Bot commented on YARN-2162: -- Github user flyrain commented on a diff in the pull request:

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135983#comment-16135983 ] Hadoop QA commented on YARN-7064: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7049) FSAppAttempt preemption related fields have confusing names

2017-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-7049: --- Attachment: YARN-7049.002.patch v2 patch fixes the checkstyle issue. No tests since no change

[jira] [Commented] (YARN-7053) Move curator transaction support to ZKCuratorManager

2017-08-21 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135960#comment-16135960 ] Jonathan Hung commented on YARN-7053: - Thanks [~subru] for the review. Added a ZKCuratorManager test.

[jira] [Created] (YARN-7066) Add ability to specify volumes to mount for DockerContainerExecutor

2017-08-21 Thread Eric Yang (JIRA)
Eric Yang created YARN-7066: --- Summary: Add ability to specify volumes to mount for DockerContainerExecutor Key: YARN-7066 URL: https://issues.apache.org/jira/browse/YARN-7066 Project: Hadoop YARN

[jira] [Updated] (YARN-7053) Move curator transaction support to ZKCuratorManager

2017-08-21 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7053: Attachment: YARN-7053.003.patch > Move curator transaction support to ZKCuratorManager >

[jira] [Commented] (YARN-6523) RM requires large memory in sending out security tokens as part of Node Heartbeat in large cluster

2017-08-21 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135951#comment-16135951 ] Ray Chiang commented on YARN-6523: -- Looks like there hasn't been much movement on this recently.

[jira] [Commented] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135950#comment-16135950 ] Hadoop QA commented on YARN-6736: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6047) Documentation updates for TimelineService v2

2017-08-21 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6047: - Attachment: YARN-6047-YARN-5355.0005.patch Thanks [~rohithsharma] and [~varun_saxena]. I have updated the

[jira] [Commented] (YARN-4227) FairScheduler: RM quits processing expired container from a removed node

2017-08-21 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135938#comment-16135938 ] Steven Rand commented on YARN-4227: --- I'm seeing a similar issue on what's roughly branch-2 (CDH 5.11.0),

[jira] [Commented] (YARN-2416) InvalidStateTransitonException in ResourceManager if AMLauncher does not receive response for startContainers() call in time

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135935#comment-16135935 ] Hadoop QA commented on YARN-2416: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3661) Basic Federation UI

2017-08-21 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135928#comment-16135928 ] Giovanni Matteo Fumarola commented on YARN-3661: Thanks [~elgoiri]. Few additional feedback

[jira] [Comment Edited] (YARN-3661) Basic Federation UI

2017-08-21 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135928#comment-16135928 ] Giovanni Matteo Fumarola edited comment on YARN-3661 at 8/21/17 10:21 PM:

[jira] [Commented] (YARN-6876) Create an abstract log writer for extendability

2017-08-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135926#comment-16135926 ] Junping Du commented on YARN-6876: -- Thanks [~xgong] for uploading the patch. Sorry for coming late on

[jira] [Commented] (YARN-7010) Federation: routing REST invocations transparently to multiple RMs (part 2 - getApps)

2017-08-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135893#comment-16135893 ] Carlo Curino commented on YARN-7010: Thanks [~giovanni.fumarola] for the patch. Few concerns below. #

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-08-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.001.patch Fixing checkstyle and findbugs. >

[jira] [Updated] (YARN-3661) Basic Federation UI

2017-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-3661: -- Attachment: YARN-3661-001.patch Tackled some comments from [~giovanni.fumarola]. > Basic Federation UI

[jira] [Created] (YARN-7065) [RM UI] App status not getting updated in "All application" page

2017-08-21 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7065: Summary: [RM UI] App status not getting updated in "All application" page Key: YARN-7065 URL: https://issues.apache.org/jira/browse/YARN-7065 Project: Hadoop YARN

[jira] [Updated] (YARN-6251) Add support for async Container release to prevent deadlock during container updates

2017-08-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6251: -- Attachment: (was: YARN-6251.007.patch) > Add support for async Container release to prevent deadlock

[jira] [Updated] (YARN-6251) Add support for async Container release to prevent deadlock during container updates

2017-08-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6251: -- Attachment: YARN-6251.007.patch Had attached the wrong patch earlier. Removed and re-attached. > Add

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

2017-08-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135842#comment-16135842 ] Miklos Szegedi commented on YARN-6668: -- Opened YARN-7064 to continue with this patch. > Use cgroup to

[jira] [Commented] (YARN-6251) Add support for async Container release to prevent deadlock during container updates

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135837#comment-16135837 ] Hadoop QA commented on YARN-6251: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2017-08-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.000.patch [~haibochen], please review this patch. > Use cgroup to get

[jira] [Created] (YARN-7064) Use cgroup to get container resource utilization

2017-08-21 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7064: Summary: Use cgroup to get container resource utilization Key: YARN-7064 URL: https://issues.apache.org/jira/browse/YARN-7064 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-08-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135811#comment-16135811 ] Miklos Szegedi commented on YARN-6384: -- Please rebase your patch against the latest trunk. > Add

[jira] [Commented] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-08-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135808#comment-16135808 ] Miklos Szegedi commented on YARN-6384: -- Thank you for the patch [~lolee_k], I have a few comments.

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135798#comment-16135798 ] Hadoop QA commented on YARN-6668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5603) Metrics for Federation StateStore

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135795#comment-16135795 ] Hadoop QA commented on YARN-5603: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2017-08-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135750#comment-16135750 ] Eric Yang edited comment on YARN-4266 at 8/21/17 8:40 PM: -- [~ebadger] I think the

[jira] [Updated] (YARN-6251) Add support for async Container release to prevent deadlock during container updates

2017-08-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6251: -- Attachment: YARN-6251.007.patch Rebasing latest patch against trunk > Add support for async Container

[jira] [Updated] (YARN-2416) InvalidStateTransitonException in ResourceManager if AMLauncher does not receive response for startContainers() call in time

2017-08-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-2416: -- Attachment: YARN-2416.003.patch Good catch, [~jlowe]. Updated the patch to include these race

[jira] [Updated] (YARN-6955) Handle concurrent register AM requests in FederationInterceptor

2017-08-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6955: - Parent Issue: YARN-2915 (was: YARN-5597) > Handle concurrent register AM requests in

[jira] [Updated] (YARN-7062) yarn job args changed by ContainerLaunch.expandEnvironment(), such as "{{" and "}}"

2017-08-21 Thread Lingfeng Su (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lingfeng Su updated YARN-7062: -- Priority: Major (was: Minor) > yarn job args changed by ContainerLaunch.expandEnvironment(), such as

[jira] [Commented] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2017-08-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135750#comment-16135750 ] Eric Yang commented on YARN-4266: - [~ebadger] I think the idea is correct to use -u=$(id -u $(whoami)):$(id

[jira] [Commented] (YARN-7053) Move curator transaction support to ZKCuratorManager

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135747#comment-16135747 ] Hadoop QA commented on YARN-7053: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2416) InvalidStateTransitonException in ResourceManager if AMLauncher does not receive response for startContainers() call in time

2017-08-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135721#comment-16135721 ] Jason Lowe commented on YARN-2416: -- Thanks for the patch! In general patch looks good, but arguably there

[jira] [Updated] (YARN-6668) Use cgroup to get container resource utilization

2017-08-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6668: - Attachment: YARN-6668.009.patch Thank you for the reviews [~haibochen]. I attached a test that is

[jira] [Updated] (YARN-5603) Metrics for Federation StateStore

2017-08-21 Thread Ellen Hui (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ellen Hui updated YARN-5603: Attachment: YARN-5603.003.patch One more checkstyle fix. > Metrics for Federation StateStore >

[jira] [Commented] (YARN-2162) add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

2017-08-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135652#comment-16135652 ] ASF GitHub Bot commented on YARN-2162: -- Github user flyrain commented on a diff in the pull request:

[jira] [Updated] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2017-08-21 Thread Aaron Gresch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Gresch updated YARN-6736: --- Attachment: YARN-6736-YARN-5355.003.patch > Consider writing to both ats v1 & v2 from RM for smoother

[jira] [Commented] (YARN-5603) Metrics for Federation StateStore

2017-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135645#comment-16135645 ] Hadoop QA commented on YARN-5603: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7053) Move curator transaction support to ZKCuratorManager

2017-08-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135621#comment-16135621 ] Subru Krishnan commented on YARN-7053: -- Thanks [~jhung] for working on this. The patch looks good,

[jira] [Commented] (YARN-6979) Add flag to notify all types of container updates to NM via NodeHeartbeatResponse

2017-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135597#comment-16135597 ] Wangda Tan commented on YARN-6979: -- Reference:

[jira] [Updated] (YARN-5603) Metrics for Federation StateStore

2017-08-21 Thread Ellen Hui (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ellen Hui updated YARN-5603: Attachment: YARN-5603.002.patch Checkstyle fixes > Metrics for Federation StateStore >

[jira] [Commented] (YARN-6979) Add flag to notify all types of container updates to NM via NodeHeartbeatResponse

2017-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135590#comment-16135590 ] Wangda Tan commented on YARN-6979: -- [~asuresh], It looks like this patch removed one public API:

[jira] [Comment Edited] (YARN-6979) Add flag to notify all types of container updates to NM via NodeHeartbeatResponse

2017-08-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135582#comment-16135582 ] Arun Suresh edited comment on YARN-6979 at 8/21/17 6:40 PM: [~leftnoteasy], so

[jira] [Commented] (YARN-6979) Add flag to notify all types of container updates to NM via NodeHeartbeatResponse

2017-08-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135582#comment-16135582 ] Arun Suresh commented on YARN-6979: --- [~leftnoteasy], so with respect to protobuf changes, we havn't

[jira] [Commented] (YARN-2162) add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

2017-08-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16135565#comment-16135565 ] ASF GitHub Bot commented on YARN-2162: -- Github user flyrain commented on a diff in the pull request:

  1   2   >