[jira] [Updated] (YARN-810) Support CGroup ceiling enforcement on CPU

2014-10-23 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-810: Issue Type: Improvement (was: Bug) Support CGroup ceiling enforcement on CPU

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181053#comment-14181053 ] Hadoop QA commented on YARN-810: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181055#comment-14181055 ] Hadoop QA commented on YARN-2724: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2724: Attachment: YARN-2724.3.patch fix -1 on findBug If an unreadable file is encountered during log

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181074#comment-14181074 ] Hadoop QA commented on YARN-2724: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181090#comment-14181090 ] Hadoop QA commented on YARN-2701: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181252#comment-14181252 ] Hudson commented on YARN-2198: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #721 (See

[jira] [Commented] (YARN-2700) TestSecureRMRegistryOperations failing on windows: auth problems

2014-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181260#comment-14181260 ] Hudson commented on YARN-2700: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #721 (See

[jira] [Commented] (YARN-2732) Fix syntax error in SecureContainer.apt.vm

2014-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181257#comment-14181257 ] Hudson commented on YARN-2732: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #721 (See

[jira] [Commented] (YARN-2495) Allow admin specify labels in each NM (Distributed configuration)

2014-10-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181304#comment-14181304 ] Naganarasimha G R commented on YARN-2495: - Thanks for reviewing Wangda : bq. 2) It

[jira] [Commented] (YARN-2700) TestSecureRMRegistryOperations failing on windows: auth problems

2014-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181386#comment-14181386 ] Hudson commented on YARN-2700: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1910 (See

[jira] [Commented] (YARN-2692) ktutil test hanging on some machines/ktutil versions

2014-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181381#comment-14181381 ] Hudson commented on YARN-2692: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1910 (See

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181378#comment-14181378 ] Hudson commented on YARN-2198: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1910 (See

[jira] [Commented] (YARN-2732) Fix syntax error in SecureContainer.apt.vm

2014-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181383#comment-14181383 ] Hudson commented on YARN-2732: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1910 (See

[jira] [Commented] (YARN-2678) Recommended improvements to Yarn Registry

2014-10-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181415#comment-14181415 ] Steve Loughran commented on YARN-2678: -- this is what a record now looks like {code} {

[jira] [Commented] (YARN-2700) TestSecureRMRegistryOperations failing on windows: auth problems

2014-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181448#comment-14181448 ] Hudson commented on YARN-2700: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1935 (See

[jira] [Commented] (YARN-2732) Fix syntax error in SecureContainer.apt.vm

2014-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181445#comment-14181445 ] Hudson commented on YARN-2732: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1935 (See

[jira] [Commented] (YARN-2692) ktutil test hanging on some machines/ktutil versions

2014-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181443#comment-14181443 ] Hudson commented on YARN-2692: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1935 (See

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-10-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181440#comment-14181440 ] Hudson commented on YARN-2198: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1935 (See

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue info including labels of such queue

2014-10-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181474#comment-14181474 ] Sunil G commented on YARN-2647: --- Thank you Wangda. Sure. I will use the QueueInfo itself.

[jira] [Commented] (YARN-2183) Cleaner service for cache manager

2014-10-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181502#comment-14181502 ] Sangjin Lee commented on YARN-2183: --- Thanks for the review [~kasha]! {quote} I

[jira] [Commented] (YARN-2722) Disable SSLv3 (POODLEbleed vulnerability) in YARN shuffle

2014-10-23 Thread Stephen Chu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181560#comment-14181560 ] Stephen Chu commented on YARN-2722: --- Hi [~ywskycn], thanks for making this change. Java 6

[jira] [Commented] (YARN-2505) Support get/add/remove/change labels in RM REST API

2014-10-23 Thread Sumit Kumar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181582#comment-14181582 ] Sumit Kumar commented on YARN-2505: --- bq. I would think that should be a post with a (list

[jira] [Created] (YARN-2734) If a sub-folder is encountered by log aggregator it results in invalid aggregated file

2014-10-23 Thread Sumit Mohanty (JIRA)
Sumit Mohanty created YARN-2734: --- Summary: If a sub-folder is encountered by log aggregator it results in invalid aggregated file Key: YARN-2734 URL: https://issues.apache.org/jira/browse/YARN-2734

[jira] [Commented] (YARN-2722) Disable SSLv3 (POODLEbleed vulnerability) in YARN shuffle

2014-10-23 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181588#comment-14181588 ] Wei Yan commented on YARN-2722: --- Thanks, [~schu]. You're right, we shouldn't add TLSv1.2. And

[jira] [Assigned] (YARN-2734) If a sub-folder is encountered by log aggregator it results in invalid aggregated file

2014-10-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-2734: --- Assignee: Xuan Gong If a sub-folder is encountered by log aggregator it results in invalid

[jira] [Updated] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2724: Attachment: YARN-2724.4.patch If an unreadable file is encountered during log aggregation then aggregated

[jira] [Commented] (YARN-2701) Potential race condition in startLocalizer when using LinuxContainerExecutor

2014-10-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181616#comment-14181616 ] Jian He commented on YARN-2701: --- lgtm too, thanks Binglin and Zhihai for reviewing the patch

[jira] [Commented] (YARN-2495) Allow admin specify labels in each NM (Distributed configuration)

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181646#comment-14181646 ] Wangda Tan commented on YARN-2495: -- 1) bq. But was thinking about one sceanario labels

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue info including labels of such queue

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181661#comment-14181661 ] Wangda Tan commented on YARN-2647: -- Hi [~sunilg], Maybe my previous comment make you

[jira] [Commented] (YARN-2734) If a sub-folder is encountered by log aggregator it results in invalid aggregated file

2014-10-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181664#comment-14181664 ] Xuan Gong commented on YARN-2734: - Currently, if the current path is a sub-folder, we will

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181665#comment-14181665 ] Zhijie Shen commented on YARN-2724: --- +1 for the latest patch. Will commit it later today

[jira] [Assigned] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2726: Assignee: Wangda Tan (was: Naganarasimha G R) CapacityScheduler should explicitly log when an

[jira] [Commented] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181673#comment-14181673 ] Wangda Tan commented on YARN-2726: -- Taking this over.. CapacityScheduler should

[jira] [Commented] (YARN-2722) Disable SSLv3 (POODLEbleed vulnerability) in YARN shuffle

2014-10-23 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181677#comment-14181677 ] Wei Yan commented on YARN-2722: --- Hi, [~schu]. Discussed with Robert offline, and we also need

[jira] [Commented] (YARN-2183) Cleaner service for cache manager

2014-10-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181684#comment-14181684 ] Karthik Kambatla commented on YARN-2183: bq. Without this check, we would have two

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-23 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181688#comment-14181688 ] Mit Desai commented on YARN-2724: - I'll take a look shortly. If an unreadable file is

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181690#comment-14181690 ] Hadoop QA commented on YARN-2724: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue info including labels of such queue

2014-10-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181701#comment-14181701 ] Sunil G commented on YARN-2647: --- Thank you [~gp.leftnoteasy] Yes. This is more or like what

[jira] [Resolved] (YARN-2473) YARN never cleans up container directories from a full disk

2014-10-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved YARN-2473. -- Resolution: Duplicate Closing as a duplicate of YARN-90. YARN never cleans up container directories

[jira] [Commented] (YARN-2678) Recommended improvements to Yarn Registry

2014-10-23 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181709#comment-14181709 ] Gour Saha commented on YARN-2678: - Steve it looks good. On the addresses front, do you plan

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue info including labels of such queue

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181717#comment-14181717 ] Wangda Tan commented on YARN-2647: -- bq. I do not feel above config is needed to show node

[jira] [Commented] (YARN-2183) Cleaner service for cache manager

2014-10-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181723#comment-14181723 ] Sangjin Lee commented on YARN-2183: --- You mean, moving the method to SCMStore but mark it

[jira] [Updated] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2726: - Attachment: YARN-2726-20141023-1.patch CapacityScheduler should explicitly log when an accessible label

[jira] [Updated] (YARN-2694) Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2694: - Summary: Ensure only single node labels specified in resource request / host, and node label expression

[jira] [Created] (YARN-2735) diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection

2014-10-23 Thread zhihai xu (JIRA)
zhihai xu created YARN-2735: --- Summary: diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection Key: YARN-2735 URL: https://issues.apache.org/jira/browse/YARN-2735

[jira] [Updated] (YARN-2694) Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2694: - Description: Currently, node label expression supporting in capacity scheduler is partial completed. Now

[jira] [Updated] (YARN-2735) diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection

2014-10-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2735: Attachment: YARN-2735.000.patch diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are

[jira] [Commented] (YARN-2735) diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection

2014-10-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181764#comment-14181764 ] zhihai xu commented on YARN-2735: - I attached a patch to remove the unnecessary

[jira] [Commented] (YARN-2183) Cleaner service for cache manager

2014-10-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181772#comment-14181772 ] Karthik Kambatla commented on YARN-2183: Yes. Sorry for the confusion. Just looked

[jira] [Commented] (YARN-2495) Allow admin specify labels in each NM (Distributed configuration)

2014-10-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181771#comment-14181771 ] Naganarasimha G R commented on YARN-2495: - hi [~wangda] Actually what i meant was

[jira] [Created] (YARN-2736) Job.getHistoryUrl returns empty string

2014-10-23 Thread Kannan Rajah (JIRA)
Kannan Rajah created YARN-2736: -- Summary: Job.getHistoryUrl returns empty string Key: YARN-2736 URL: https://issues.apache.org/jira/browse/YARN-2736 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-2703) Add logUploadedTime into LogValue for better display

2014-10-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181791#comment-14181791 ] Zhijie Shen commented on YARN-2703: --- [~xgong], thanks for the patch. Some comments about

[jira] [Updated] (YARN-2505) Support get/add/remove/change labels in RM REST API

2014-10-23 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2505: -- Attachment: YARN-2505.7.patch Add forgotten generic type definitions, should fix javac warnings...

[jira] [Updated] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2724: Attachment: YARN-2724.5.patch Same patch If an unreadable file is encountered during log aggregation then

[jira] [Commented] (YARN-2505) Support get/add/remove/change labels in RM REST API

2014-10-23 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181798#comment-14181798 ] Craig Welch commented on YARN-2505: --- -re I think it would be enough to provide support

[jira] [Commented] (YARN-2314) ContainerManagementProtocolProxy can create thousands of threads for a large cluster

2014-10-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181809#comment-14181809 ] Jason Lowe commented on YARN-2314: -- bq. IIUC, mayBeCloseProxy can be invoked by

[jira] [Commented] (YARN-2735) diskUtilizationPercentageCutoff and diskUtilizationSpaceCutoff are initialized twice in DirectoryCollection

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181814#comment-14181814 ] Hadoop QA commented on YARN-2735: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181838#comment-14181838 ] Hadoop QA commented on YARN-2724: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2495) Allow admin specify labels in each NM (Distributed configuration)

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181859#comment-14181859 ] Wangda Tan commented on YARN-2495: -- Hi Naga, bq. you meant NodeHeartBeatResponse right ?

[jira] [Commented] (YARN-2314) ContainerManagementProtocolProxy can create thousands of threads for a large cluster

2014-10-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181869#comment-14181869 ] Jian He commented on YARN-2314: --- Jason, thanks for your explanation. bq. If the cache never

[jira] [Commented] (YARN-2505) Support get/add/remove/change labels in RM REST API

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181908#comment-14181908 ] Hadoop QA commented on YARN-2505: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2209) Replace AM resync/shutdown command with corresponding exceptions

2014-10-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181929#comment-14181929 ] Jian He commented on YARN-2209: --- bq. No need to change to split a single statement into the

[jira] [Updated] (YARN-2694) Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2694: - Attachment: YARN-2694-20141023-1.patch Updated patch Ensure only single node labels specified

[jira] [Updated] (YARN-2209) Replace AM resync/shutdown command with corresponding exceptions

2014-10-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2209: -- Attachment: YARN-2209.7.patch Thanks zhijie for the review! addressed other comments Replace AM

[jira] [Created] (YARN-2737) Misleading msg in LogCLI when app is not successfully submitted

2014-10-23 Thread Jian He (JIRA)
Jian He created YARN-2737: - Summary: Misleading msg in LogCLI when app is not successfully submitted Key: YARN-2737 URL: https://issues.apache.org/jira/browse/YARN-2737 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-2703) Add logUploadedTime into LogValue for better display

2014-10-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2703: Attachment: YARN-2703.3.patch Add logUploadedTime into LogValue for better display

[jira] [Commented] (YARN-2703) Add logUploadedTime into LogValue for better display

2014-10-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181998#comment-14181998 ] Xuan Gong commented on YARN-2703: - Addressed all comments Add logUploadedTime into

[jira] [Commented] (YARN-2694) Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY

2014-10-23 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12676721/YARN-2694-20141023-1.patch against trunk revision 828429d. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears

[jira] [Updated] (YARN-2678) Recommended improvements to Yarn Registry

2014-10-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2678: - Attachment: yarnregistry.pdf Updated TLA specification; # covers new structure # declares that

[jira] [Updated] (YARN-2694) Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2694: - Attachment: YARN-2694-20141023-2.patch I can compile this locally, I haven't found any error message

[jira] [Commented] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-23 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12676662/YARN-2726-20141023-1.patch against trunk revision d71d40a. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't

[jira] [Updated] (YARN-2678) Recommended improvements to Yarn Registry

2014-10-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2678: - Attachment: YARN-2678-001.patch Updated patch # marshalling to ZK node without header, but check

[jira] [Commented] (YARN-2678) Recommended improvements to Yarn Registry

2014-10-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182022#comment-14182022 ] Steve Loughran commented on YARN-2678: -- Gour: I don't want to split out hostname and

[jira] [Updated] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2726: - Attachment: YARN-2726-20141023-2.patch Jenkins issue resubmit patch CapacityScheduler should explicitly

[jira] [Updated] (YARN-2722) Disable SSLv3 (POODLEbleed vulnerability) in YARN shuffle

2014-10-23 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2722: -- Attachment: YARN-2722-2.patch Disable SSLv3 (POODLEbleed vulnerability) in YARN shuffle

[jira] [Updated] (YARN-2678) Recommended improvements to Yarn Registry

2014-10-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2678: - Attachment: HADOOP-2678-002.patch Patch merging in YARN-2677 patch which is forgiving of non-DNS

[jira] [Commented] (YARN-2678) Recommended improvements to Yarn Registry

2014-10-23 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182074#comment-14182074 ] Gour Saha commented on YARN-2678: - bq. Gour: I don't want to split out hostname and port

[jira] [Commented] (YARN-2722) Disable SSLv3 (POODLEbleed vulnerability) in YARN shuffle

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182094#comment-14182094 ] Hadoop QA commented on YARN-2722: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2678) Recommended improvements to Yarn Registry

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182095#comment-14182095 ] Hadoop QA commented on YARN-2678: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2056) Disable preemption at Queue level

2014-10-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2056: - Attachment: YARN-2056.201410232244.txt Thanks very much [~leftnoteasy]. I have attached a patch which uses

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

2014-10-23 Thread Matteo Mazzucchelli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182112#comment-14182112 ] Matteo Mazzucchelli commented on YARN-2664: --- I notice that the data that are sent

[jira] [Commented] (YARN-2209) Replace AM resync/shutdown command with corresponding exceptions

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182124#comment-14182124 ] Hadoop QA commented on YARN-2209: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2183) Cleaner service for cache manager

2014-10-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2183: -- Attachment: YARN-2183-trunk-v6.patch v.6 patch posted. To see the patch in context, go to

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

2014-10-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182133#comment-14182133 ] Zhijie Shen commented on YARN-2724: --- [~mitdesai], any comments so far? If an unreadable

[jira] [Commented] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-10-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182135#comment-14182135 ] Karthik Kambatla commented on YARN-2010: [~jianhe] - can you please verify the

[jira] [Updated] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-10-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2010: --- Attachment: yarn-2010-5.patch Updated patch to fix test failure, findbugs warning, and

[jira] [Commented] (YARN-2694) Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY

2014-10-23 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12676740/YARN-2694-20141023-2.patch against trunk revision 828429d. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears

[jira] [Commented] (YARN-2726) CapacityScheduler should explicitly log when an accessible label has no capacity

2014-10-23 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12676745/YARN-2726-20141023-2.patch against trunk revision 828429d. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:red}-1 tests included{color}. The patch doesn't

[jira] [Updated] (YARN-2713) Broken RM Home link in NM Web UI when RM HA is enabled

2014-10-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2713: --- Attachment: yarn-2713-1.patch Here is a straight-forward patch that points RM Home to the

[jira] [Updated] (YARN-2713) Broken RM Home link in NM Web UI when RM HA is enabled

2014-10-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2713: --- Fix Version/s: (was: 2.7.0) Broken RM Home link in NM Web UI when RM HA is enabled

[jira] [Commented] (YARN-2713) Broken RM Home link in NM Web UI when RM HA is enabled

2014-10-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182195#comment-14182195 ] Karthik Kambatla commented on YARN-2713: [~xgong] - I believe you are the most

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

2014-10-23 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182205#comment-14182205 ] Carlo Curino commented on YARN-2664: Matteo, first of all, thanks for looking into

[jira] [Commented] (YARN-2713) Broken RM Home link in NM Web UI when RM HA is enabled

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182242#comment-14182242 ] Hadoop QA commented on YARN-2713: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182245#comment-14182245 ] Hadoop QA commented on YARN-2010: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2703) Add logUploadedTime into LogValue for better display

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182247#comment-14182247 ] Hadoop QA commented on YARN-2703: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-10-23 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2010: --- Attachment: yarn-2010-6.patch Updated patch to fix the findbugs issue, it was due to an empty

[jira] [Commented] (YARN-2495) Allow admin specify labels in each NM (Distributed configuration)

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182257#comment-14182257 ] Wangda Tan commented on YARN-2495: -- [~Naganarasimha], One comment before you uploading

[jira] [Commented] (YARN-2704) Localization and log-aggregation will fail if hdfs delegation token expired after token-max-life-time

2014-10-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182291#comment-14182291 ] Jian He commented on YARN-2704: --- Thanks Vinod for the review ! bq.

[jira] [Commented] (YARN-2010) If RM fails to recover an app, it can never transition to active again

2014-10-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182302#comment-14182302 ] Hadoop QA commented on YARN-2010: - {color:green}+1 overall{color}. Here are the results of

  1   2   >