[jira] [Updated] (YARN-6182) [YARN-3368] Fix alignment issues and missing information in queue pages

2017-09-12 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-6182: --- Description: This patch fixes following issues: In Queues page: # Queue Capacities: Absolute Max Capacity

[jira] [Commented] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-09-12 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164150#comment-16164150 ] Zhankun Tang commented on YARN-6852: [~wangda], Yeah. At present, all supported resource type needs to

[jira] [Updated] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7186: -- Attachment: YARN-7186.yarn-native-services.03.patch > Add examples in yarn-service >

[jira] [Commented] (YARN-7172) ResourceCalculator.fitsIn() should not take a cluster resource parameter

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164098#comment-16164098 ] Hadoop QA commented on YARN-7172: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164024#comment-16164024 ] Hadoop QA commented on YARN-2664: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7172) ResourceCalculator.fitsIn() should not take a cluster resource parameter

2017-09-12 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16164020#comment-16164020 ] Sen Zhao commented on YARN-7172: Thanks for your review, [~templedf] and [~leftnoteasy]. I will commit

[jira] [Updated] (YARN-7172) ResourceCalculator.fitsIn() should not take a cluster resource parameter

2017-09-12 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-7172: --- Attachment: YARN-7172.006.patch > ResourceCalculator.fitsIn() should not take a cluster resource parameter >

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163934#comment-16163934 ] Miklos Szegedi commented on YARN-7034: -- The branch-2 patches are failing due to YARN-7187. >

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163932#comment-16163932 ] Miklos Szegedi commented on YARN-7034: -- The unit tests should be unrelated. The previous test without

[jira] [Updated] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7034: - Priority: Blocker (was: Critical) > DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime

[jira] [Updated] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7034: - Priority: Critical (was: Blocker) > DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime

[jira] [Comment Edited] (YARN-5972) Support Pausing/Freezing of opportunistic containers

2017-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163703#comment-16163703 ] Arun Suresh edited comment on YARN-5972 at 9/13/17 12:21 AM: - I was not sure if

[jira] [Commented] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when OPPORTUNISTIC container queuing is enabled.

2017-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163924#comment-16163924 ] Hudson commented on YARN-7185: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12855 (See

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163910#comment-16163910 ] Hadoop QA commented on YARN-7034: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163904#comment-16163904 ] Hadoop QA commented on YARN-7186: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163906#comment-16163906 ] Wangda Tan commented on YARN-6620: -- [~devaraj.k], Thanks for reviewing the patch. Only several

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163874#comment-16163874 ] Gour Saha commented on YARN-7186: - Ok, if it is relative to HADOOP_YARN_HOME then it is fine. We don't need

[jira] [Commented] (YARN-7057) FSAppAttempt#getResourceUsage doesn't need to consider resources queued for preemption

2017-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163876#comment-16163876 ] Hudson commented on YARN-7057: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12854 (See

[jira] [Comment Edited] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163859#comment-16163859 ] Jian He edited comment on YARN-7186 at 9/12/17 11:34 PM: - no, it is not absolute,

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163859#comment-16163859 ] Jian He commented on YARN-7186: --- no, it is not absolute, it is relative to the HADOOP_HOME. bq. I see this as

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163857#comment-16163857 ] Gour Saha commented on YARN-7186: - bq. The files are located under

[jira] [Commented] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when OPPORTUNISTIC container queuing is enabled.

2017-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163852#comment-16163852 ] Hudson commented on YARN-7185: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12853 (See

[jira] [Updated] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7034: - Target Version/s: 2.9.0, 3.0.0-beta1, 2.8.2 Add target versions to remind as a potentially blocker. >

[jira] [Commented] (YARN-7057) FSAppAttempt#getResourceUsage doesn't need to consider resources queued for preemption

2017-09-12 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163832#comment-16163832 ] Yufei Gu commented on YARN-7057: Committed to trunk and branch-2. Thanks for the patch, [~kasha]. Thanks

[jira] [Updated] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7034: - Attachment: YARN-7034.003.patch Fixing checkstyle. > DefaultLinuxContainerRuntime and

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

2017-09-12 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-2664: -- Attachment: YARN-2664.18.patch > Improve RM webapp to expose info about reservations. >

[jira] [Commented] (YARN-7057) FSAppAttempt#getResourceUsage doesn't need to consider resources queued for preemption

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163824#comment-16163824 ] Hadoop QA commented on YARN-7057: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when OPPORTUNISTIC container queuing is enabled.

2017-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7185: -- Summary: ContainerScheduler should only look at availableResource for GUARANTEED containers when

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163819#comment-16163819 ] Hadoop QA commented on YARN-7034: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163812#comment-16163812 ] Arun Suresh commented on YARN-7185: --- +1 Will commit this shortly > ContainerScheduler should only look

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163796#comment-16163796 ] Jian He commented on YARN-7186: --- uploaded a new patch, The command is now like this: {code} yarn service

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163794#comment-16163794 ] Jian He commented on YARN-7186: --- The files are located under "share/hadoop/yarn/yarn-service-examples", I

[jira] [Updated] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7186: -- Attachment: YARN-7186.yarn-native-services.02.patch > Add examples in yarn-service >

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163788#comment-16163788 ] Hadoop QA commented on YARN-7034: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163785#comment-16163785 ] Wangda Tan commented on YARN-7185: -- [~asuresh], test failure is not related. I was trying to add to the

[jira] [Updated] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7034: - Attachment: YARN-7034.002.patch Rebasing the trunk patch. > DefaultLinuxContainerRuntime and

[jira] [Commented] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163777#comment-16163777 ] Hadoop QA commented on YARN-7185: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163766#comment-16163766 ] Miklos Szegedi commented on YARN-7034: -- [~vinodkv], I think we should apply this jira without any

[jira] [Updated] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7034: - Attachment: YARN-7034.branch-2.000.patch YARN-7034.branch-2.8.000.patch Adding

[jira] [Commented] (YARN-7146) Many RM unit tests failing with FairScheduler

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163750#comment-16163750 ] Hadoop QA commented on YARN-7146: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7057) FSAppAttempt#getResourceUsage doesn't need to consider resources queued for preemption

2017-09-12 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7057: --- Attachment: YARN-7057.002.patch Rebase with patch v2. > FSAppAttempt#getResourceUsage doesn't need to

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-09-12 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163715#comment-16163715 ] Yufei Gu commented on YARN-6612: Thanks for removing the class ResourceWeight. Looks good to me generally.

[jira] [Comment Edited] (YARN-5972) Support Pausing/Freezing of opportunistic containers

2017-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163703#comment-16163703 ] Arun Suresh edited comment on YARN-5972 at 9/12/17 9:40 PM: I was not sure if

[jira] [Commented] (YARN-5972) Support Pausing/Freezing of opportunistic containers

2017-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163703#comment-16163703 ] Arun Suresh commented on YARN-5972: --- I was not sure if we needed a formal merge vote for this - given

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-09-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163702#comment-16163702 ] Jason Lowe commented on YARN-6726: -- The branch-2 patch also has the off-by-one error in it, see YARN-7014.

[jira] [Commented] (YARN-7187) branch-2 native compilation broken in hadoop-yarn-server-nodemanager

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163699#comment-16163699 ] Wangda Tan commented on YARN-7187: -- [~varun_saxena], I suggest to backport YARN-5719 instead of fixing the

[jira] [Commented] (YARN-7187) branch-2 native compilation broken in hadoop-yarn-server-nodemanager

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163694#comment-16163694 ] Hadoop QA commented on YARN-7187: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-6838) Add support to LinuxContainerExecutor to support container PAUSE

2017-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-6838: - Assignee: Arun Suresh > Add support to LinuxContainerExecutor to support container PAUSE >

[jira] [Commented] (YARN-6977) Node information is not provided for non am containers in RM logs

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163679#comment-16163679 ] Wangda Tan commented on YARN-6977: -- [~suma.shivaprasad], thanks for updating the patch, patch LGTM, could

[jira] [Updated] (YARN-7187) branch-2 native compilation broken in hadoop-yarn-server-nodemanager

2017-09-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-7187: --- Priority: Blocker (was: Major) > branch-2 native compilation broken in hadoop-yarn-server-nodemanager

[jira] [Updated] (YARN-6838) Add support to LinuxContainerExecutor to support container PAUSE

2017-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6838: -- Issue Type: Improvement (was: Sub-task) Parent: (was: YARN-5972) > Add support to

[jira] [Commented] (YARN-7146) Many RM unit tests failing with FairScheduler

2017-09-12 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163660#comment-16163660 ] Grant Sohn commented on YARN-7146: -- +1 (non-binding) LGTM. > Many RM unit tests failing with

[jira] [Commented] (YARN-7187) branch-2 native compilation broken in hadoop-yarn-server-nodemanager

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163638#comment-16163638 ] Hadoop QA commented on YARN-7187: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7183) YARN - State vs Final Status - Discrepancy in 2.8.1

2017-09-12 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163615#comment-16163615 ] Anbu Cheeralan commented on YARN-7183: -- [~rohit12sh] - Were you able to look into this issue? > YARN

[jira] [Updated] (YARN-7187) branch-2 native compilation broken in hadoop-yarn-server-nodemanager

2017-09-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-7187: --- Attachment: YARN-7187-branch-2.patch > branch-2 native compilation broken in

[jira] [Commented] (YARN-6977) Node information is not provided for non am containers in RM logs

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163601#comment-16163601 ] Hadoop QA commented on YARN-6977: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6059) Update paused container state in the NM state store

2017-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6059: -- Summary: Update paused container state in the NM state store (was: Update paused container state in the

[jira] [Comment Edited] (YARN-7187) branch-2 native compilation broken in hadoop-yarn-server-nodemanager

2017-09-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163566#comment-16163566 ] Varun Saxena edited comment on YARN-7187 at 9/12/17 8:17 PM: - YARN-5719 does

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163591#comment-16163591 ] Hadoop QA commented on YARN-6612: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163589#comment-16163589 ] Gour Saha commented on YARN-7186: - bq. Yes, it is not very convenient having the name specified in the

[jira] [Commented] (YARN-7187) branch-2 native compilation broken in hadoop-yarn-server-nodemanager

2017-09-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163566#comment-16163566 ] Varun Saxena commented on YARN-7187: YARN-5719 does not exist in branch-2. Should it be cherry-picked

[jira] [Moved] (YARN-7187) branch-2 native compilation broken in hadoop-yarn-server-nodemanager

2017-09-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena moved HADOOP-14863 to YARN-7187: - Key: YARN-7187 (was: HADOOP-14863) Project: Hadoop YARN (was:

[jira] [Updated] (YARN-7146) Many RM unit tests failing with FairScheduler

2017-09-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-7146: Attachment: YARN-7146.004.patch The 004 patch: - Added a message to {{assertNull}} in

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163522#comment-16163522 ] Billie Rinaldi commented on YARN-7186: -- bq. I now think [service-name] can be optional, because for

[jira] [Commented] (YARN-7172) ResourceCalculator.fitsIn() should not take a cluster resource parameter

2017-09-12 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163505#comment-16163505 ] Daniel Templeton commented on YARN-7172: Boo. Let's take care of the unused imports, and then we

[jira] [Commented] (YARN-7063) TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2

2017-09-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163503#comment-16163503 ] Haibo Chen commented on YARN-7063: -- Thanks [~vrushalic]. I have set the fix version accordingly. >

[jira] [Updated] (YARN-7063) TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2

2017-09-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7063: - Fix Version/s: YARN-5335_branch2 > TestTimelineReaderWebServicesHBaseStorage fails with

[jira] [Commented] (YARN-7063) TestTimelineReaderWebServicesHBaseStorage fails with NoClassDefFoundError on TSv2 branch2

2017-09-12 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163500#comment-16163500 ] Vrushali C commented on YARN-7063: -- Thanks [~varun_saxena], patch LGTM [~haibo.chen] thanks for the

[jira] [Commented] (YARN-7172) ResourceCalculator.fitsIn() should not take a cluster resource parameter

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163501#comment-16163501 ] Hadoop QA commented on YARN-7172: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7172) ResourceCalculator.fitsIn() should not take a cluster resource parameter

2017-09-12 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163496#comment-16163496 ] Daniel Templeton commented on YARN-7172: Guess I should wait for Jenkins to report on the rebase.

[jira] [Updated] (YARN-6977) Node information is not provided for non am containers in RM logs

2017-09-12 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-6977: --- Attachment: YARN-6977.002.patch Modified patch with debug logs for FSSchedulerNode and info

[jira] [Commented] (YARN-7146) Many RM unit tests failing with FairScheduler

2017-09-12 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163495#comment-16163495 ] Daniel Templeton commented on YARN-7146: Looks good. One minor nit in

[jira] [Commented] (YARN-6059) Update paused container state in the state store

2017-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163478#comment-16163478 ] Arun Suresh commented on YARN-6059: --- +1 for the latest patch. Will commit it shortly (will fix the

[jira] [Commented] (YARN-6059) Update paused container state in the state store

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163474#comment-16163474 ] Hadoop QA commented on YARN-6059: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6630) Container worker dir could not recover when NM restart

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163459#comment-16163459 ] Hadoop QA commented on YARN-6630: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6630) Container worker dir could not recover when NM restart

2017-09-12 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163455#comment-16163455 ] Junping Du commented on YARN-6630: -- Sorry for coming late on this. Sounds like the patch doesn't apply to

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163452#comment-16163452 ] Jian He commented on YARN-7186: --- I now think \[service-name\] can be optional, because for trying the example

[jira] [Commented] (YARN-7172) ResourceCalculator.fitsIn() should not take a cluster resource parameter

2017-09-12 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163443#comment-16163443 ] Daniel Templeton commented on YARN-7172: LGTM. +1 Sorry I'm late to the party. I'll commit this

[jira] [Updated] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-09-12 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6612: --- Attachment: YARN-6612.015.patch Rebased after the merge. > Update fair scheduler policies to

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163413#comment-16163413 ] Billie Rinaldi commented on YARN-7186: -- That's right, except the \[service-name\] has been removed now

[jira] [Commented] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163392#comment-16163392 ] Wangda Tan commented on YARN-6840: -- Thanks [~jhung] for working on this patch, just reviewed overall

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163385#comment-16163385 ] Jian He commented on YARN-7186: --- something like below: {code} yarn service create [service-name]

[jira] [Commented] (YARN-6546) SLS is slow while loading 10k queues

2017-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163380#comment-16163380 ] Hadoop QA commented on YARN-6546: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6059) Update paused container state in the state store

2017-09-12 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Sharma updated YARN-6059: Attachment: YARN-6059-YARN-5972.012.patch > Update paused container state in the state store >

[jira] [Commented] (YARN-6546) SLS is slow while loading 10k queues

2017-09-12 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163327#comment-16163327 ] Grant Sohn commented on YARN-6546: -- +1 (non-binding). Thanks for getting this addressed. > SLS is slow

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-09-12 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163313#comment-16163313 ] Varun Saxena commented on YARN-6726: [~leftnoteasy], this seems to break compilation in branch-2

[jira] [Updated] (YARN-7172) ResourceCalculator.fitsIn() should not take a cluster resource parameter

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7172: - Attachment: YARN-7172.005.patch Rebased to trunk after YARN-3926 merged. (005) >

[jira] [Commented] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163299#comment-16163299 ] Wangda Tan commented on YARN-6852: -- [~tangzhankun], I'm not quite sure about what does the first-class

[jira] [Comment Edited] (YARN-7146) Many RM unit tests failing with FairScheduler

2017-09-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162070#comment-16162070 ] Robert Kanter edited comment on YARN-7146 at 9/12/17 5:04 PM: -- Test failures

[jira] [Updated] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3926: - Description: Currently, there are efforts to add support for various resource-types such as

[jira] [Resolved] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-3926. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 This feature is merged to

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-12 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16163268#comment-16163268 ] Gour Saha commented on YARN-7186: - [~jianhe], when you re-use the create sub-cmd for the demo example, how

[jira] [Updated] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7119: - Parent Issue: YARN-7069 (was: YARN-3926) > yarn rmadmin -updateNodeResource should be updated for

[jira] [Updated] (YARN-7180) Remove class ResourceType

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7180: - Parent Issue: YARN-7069 (was: YARN-3926) > Remove class ResourceType > - > >

[jira] [Updated] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7159: - Parent Issue: YARN-7069 (was: YARN-3926) > Normalize unit of resource objects in RM and avoid to do unit

[jira] [Updated] (YARN-7166) Container REST endpoints should report resource types

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7166: - Parent Issue: YARN-7069 (was: YARN-3926) > Container REST endpoints should report resource types >

[jira] [Updated] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6995: - Parent Issue: YARN-7069 (was: YARN-3926) > Improve use of ResourceNotFoundException in resource types

[jira] [Updated] (YARN-7021) TestResourceUtils to be moved to hadoop-yarn-api package

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7021: - Parent Issue: YARN-7069 (was: YARN-3926) > TestResourceUtils to be moved to hadoop-yarn-api package >

[jira] [Updated] (YARN-6589) Recover all resources when NM restart

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6589: - Parent Issue: YARN-7069 (was: YARN-3926) > Recover all resources when NM restart >

[jira] [Updated] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-09-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7143: - Parent Issue: YARN-7069 (was: YARN-3926) > FileNotFound handling in ResourceUtils is inconsistent >

  1   2   >