[jira] [Updated] (YARN-3096) RM Configured Min User % still showing as 100% in Scheduler

2015-01-26 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sekhon updated YARN-3096: -- Attachment: screenshot-1.png RM Configured Min User % still showing as 100% in Scheduler

[jira] [Commented] (YARN-3024) LocalizerRunner should give DIE action when all resources are localized

2015-01-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291942#comment-14291942 ] Hudson commented on YARN-3024: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2036 (See

[jira] [Updated] (YARN-3096) RM Configured Min User % still showing as 100% in Scheduler

2015-01-26 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sekhon updated YARN-3096: -- Attachment: (was: screenshot-1.png) RM Configured Min User % still showing as 100% in Scheduler

[jira] [Resolved] (YARN-3096) RM Configured Min User % still showing as 100% in Scheduler

2015-01-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved YARN-3096. -- Resolution: Invalid The user interface still shows 100% because the wrong property is being set, so the

[jira] [Updated] (YARN-2897) CrossOriginFilter needs more log statements

2015-01-26 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-2897: Description: CrossOriginFilter does not log as much to make debugging easier (was: CrossOriginFilter does

[jira] [Commented] (YARN-3024) LocalizerRunner should give DIE action when all resources are localized

2015-01-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291915#comment-14291915 ] Hudson commented on YARN-3024: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #86 (See

[jira] [Commented] (YARN-3088) LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error

2015-01-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291960#comment-14291960 ] Jason Lowe commented on YARN-3088: -- +1 lgtm. Committing this.

[jira] [Commented] (YARN-3096) RM Configured Min User % still showing as 100% in Scheduler

2015-01-26 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291979#comment-14291979 ] Hari Sekhon commented on YARN-3096: --- That's weird, that was set by Ambari, maybe this is

[jira] [Commented] (YARN-3096) RM Configured Min User % still showing as 100% in Scheduler

2015-01-26 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291990#comment-14291990 ] Hari Sekhon commented on YARN-3096: --- Raised AMBARI-9331 RM Configured Min User % still

[jira] [Updated] (YARN-3096) RM Configured Min User % still showing as 100% in Scheduler

2015-01-26 Thread Hari Sekhon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sekhon updated YARN-3096: -- Attachment: screenshot-1.png RM Configured Min User % still showing as 100% in Scheduler

[jira] [Created] (YARN-3096) RM Configured Min User % still showing as 100% in Scheduler

2015-01-26 Thread Hari Sekhon (JIRA)
Hari Sekhon created YARN-3096: - Summary: RM Configured Min User % still showing as 100% in Scheduler Key: YARN-3096 URL: https://issues.apache.org/jira/browse/YARN-3096 Project: Hadoop YARN

[jira] [Commented] (YARN-3088) LinuxContainerExecutor.deleteAsUser can throw NPE if native executor returns an error

2015-01-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291978#comment-14291978 ] Hudson commented on YARN-3088: -- FAILURE: Integrated in Hadoop-trunk-Commit #6931 (See

[jira] [Commented] (YARN-3085) Application summary should include the application type

2015-01-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292044#comment-14292044 ] Jason Lowe commented on YARN-3085: -- Thanks for the patch, Rohith! For backwards

[jira] [Commented] (YARN-2718) Create a CompositeConatainerExecutor that combines DockerContainerExecutor and DefaultContainerExecutor

2015-01-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292258#comment-14292258 ] Chris Douglas commented on YARN-2718: - I share Allen's skepticism. Adding this to the

[jira] [Commented] (YARN-3028) Better syntax for replace label CLI

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292257#comment-14292257 ] Wangda Tan commented on YARN-3028: -- [~rohithsharma], could you take a look at the latest

[jira] [Commented] (YARN-3024) LocalizerRunner should give DIE action when all resources are localized

2015-01-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291881#comment-14291881 ] Hudson commented on YARN-3024: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #82 (See

[jira] [Updated] (YARN-3092) Create common ResourceUsage class to track labeled resource usages in Capacity Scheduler

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3092: - Summary: Create common ResourceUsage class to track labeled resource usages in Capacity Scheduler (was:

[jira] [Commented] (YARN-2868) Add metric for initial container launch time to FairScheduler

2015-01-26 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292235#comment-14292235 ] Ray Chiang commented on YARN-2868: -- I would like to make this metrics discussion a bit

[jira] [Updated] (YARN-3028) Better syntax for replace label CLI

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3028: - Attachment: 0003-YARN-3028.patch After YARN-2800, test will fail for this patch. Rebased patch a little

[jira] [Commented] (YARN-1743) Decorate event transitions and the event-types with their behaviour

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292277#comment-14292277 ] Wangda Tan commented on YARN-1743: -- [~zjffdu], could you add license to these files and

[jira] [Commented] (YARN-3028) Better syntax for replace label CLI

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292327#comment-14292327 ] Hadoop QA commented on YARN-3028: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2897) CrossOriginFilter needs more log statements

2015-01-26 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292354#comment-14292354 ] Jonathan Eagles commented on YARN-2897: --- [~mitdesai], can you add the get header that

[jira] [Commented] (YARN-2718) Create a CompositeConatainerExecutor that combines DockerContainerExecutor and DefaultContainerExecutor

2015-01-26 Thread Max (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292275#comment-14292275 ] Max commented on YARN-2718: --- I also think that it is not a good approach. Most likely it will not

[jira] [Commented] (YARN-2897) CrossOriginFilter needs more log statements

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292307#comment-14292307 ] Hadoop QA commented on YARN-2897: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-3098) Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues

2015-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-3098: Summary: Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues Key: YARN-3098 URL: https://issues.apache.org/jira/browse/YARN-3098

[jira] [Commented] (YARN-3025) Provide API for retrieving blacklisted nodes

2015-01-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292145#comment-14292145 ] Ted Yu commented on YARN-3025: -- The persistence of blacklisted nodes doesn't have to be 1-to-1

[jira] [Commented] (YARN-2808) yarn client tool can not list app_attempt's container info correctly

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292141#comment-14292141 ] Hadoop QA commented on YARN-2808: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292159#comment-14292159 ] Wangda Tan commented on YARN-3075: -- bq. Right now, when we getLabelsToNodes we simply

[jira] [Commented] (YARN-3092) Create common resource usage class to track labeled resource/capacity in Capacity Scheduler

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292160#comment-14292160 ] Wangda Tan commented on YARN-3092: -- Failed tests are unrelated to this change. Create

[jira] [Created] (YARN-3097) Logging of resource recovery on NM restart has redundancies

2015-01-26 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-3097: Summary: Logging of resource recovery on NM restart has redundancies Key: YARN-3097 URL: https://issues.apache.org/jira/browse/YARN-3097 Project: Hadoop YARN Issue

[jira] [Assigned] (YARN-3097) Logging of resource recovery on NM restart has redundancies

2015-01-26 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-3097: Assignee: Eric Payne Logging of resource recovery on NM restart has redundancies

[jira] [Commented] (YARN-2932) Add entry for preemptable status to scheduler web UI and queue initialize/refresh logging

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292202#comment-14292202 ] Wangda Tan commented on YARN-2932: -- Thanks for updating, [~eepayne]. New patch screenshot

[jira] [Created] (YARN-3099) Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track resources-by-label.

2015-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-3099: Summary: Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track resources-by-label. Key: YARN-3099 URL: https://issues.apache.org/jira/browse/YARN-3099

[jira] [Updated] (YARN-2897) CrossOriginFilter needs more log statements

2015-01-26 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-2897: Attachment: YARN-2897.patch Updating the patch CrossOriginFilter needs more log statements

[jira] [Updated] (YARN-3022) Expose Container resource information from NodeManager for monitoring

2015-01-26 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3022: Attachment: YARN-3022.003.patch Addressed feedback Expose Container resource information from

[jira] [Updated] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-26 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3075: --- Attachment: YARN-3075.002.patch NodeLabelsManager implementation to retrieve label to node mapping

[jira] [Updated] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-26 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3075: --- Attachment: (was: YARN-3075.002.patch) NodeLabelsManager implementation to retrieve label to node

[jira] [Updated] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-26 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3075: --- Attachment: YARN-3075.002.patch NodeLabelsManager implementation to retrieve label to node mapping

[jira] [Commented] (YARN-2897) CrossOriginFilter needs more log statements

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292436#comment-14292436 ] Hadoop QA commented on YARN-2897: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3099) Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track resources-by-label.

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3099: - Description: After YARN-3092, resource-by-label (include

[jira] [Updated] (YARN-2897) CrossOriginFilter needs more log statements

2015-01-26 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-2897: Attachment: YARN-2897.patch Thanks for taking a look [~jeagles]. Attaching the modified patch

[jira] [Commented] (YARN-3098) Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292802#comment-14292802 ] Hadoop QA commented on YARN-3098: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3030) set up ATS writer with basic request serving structure and lifecycle

2015-01-26 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3030: -- Attachment: YARN-3030.004.patch Posted patch v.4 to address Zhijie's suggestions. By adding the

[jira] [Commented] (YARN-3025) Provide API for retrieving blacklisted nodes

2015-01-26 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292848#comment-14292848 ] Bikas Saha commented on YARN-3025: -- Yes. But that would mean that the RM cannot provide

[jira] [Created] (YARN-3101) FairScheduler#fitInMaxShare was added to validate reservations but it does not consider it

2015-01-26 Thread Anubhav Dhoot (JIRA)
Anubhav Dhoot created YARN-3101: --- Summary: FairScheduler#fitInMaxShare was added to validate reservations but it does not consider it Key: YARN-3101 URL: https://issues.apache.org/jira/browse/YARN-3101

[jira] [Assigned] (YARN-3101) FairScheduler#fitInMaxShare was added to validate reservations but it does not consider it

2015-01-26 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned YARN-3101: --- Assignee: Anubhav Dhoot FairScheduler#fitInMaxShare was added to validate reservations but

[jira] [Commented] (YARN-2718) Create a CompositeConatainerExecutor that combines DockerContainerExecutor and DefaultContainerExecutor

2015-01-26 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293050#comment-14293050 ] Chun Chen commented on YARN-2718: - Yes, my mistake. Thanks for pointing out. Attach a fixed

[jira] [Updated] (YARN-3079) Scheduler should also update maximumAllocation when updateNodeResource.

2015-01-26 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3079: Attachment: YARN-3079.003.patch Scheduler should also update maximumAllocation when updateNodeResource.

[jira] [Commented] (YARN-2868) Add metric for initial container launch time to FairScheduler

2015-01-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292798#comment-14292798 ] Jian He commented on YARN-2868: --- From what I understand, both YARN-2802 and this jira are

[jira] [Commented] (YARN-3011) NM dies because of the failure of resource localization

2015-01-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292892#comment-14292892 ] Jian He commented on YARN-3011: --- bq. I feel using ConverterUtils#getPathFromYarnURL to print

[jira] [Commented] (YARN-2718) Create a CompositeConatainerExecutor that combines DockerContainerExecutor and DefaultContainerExecutor

2015-01-26 Thread Leitao Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292809#comment-14292809 ] Leitao Guo commented on YARN-2718: -- I think this is good to our hadoop cluster, since we

[jira] [Updated] (YARN-1983) Support heterogeneous container types at runtime on YARN

2015-01-26 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chun Chen updated YARN-1983: Attachment: YARN-1983.patch Support heterogeneous container types at runtime on YARN

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-01-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292804#comment-14292804 ] Jian He commented on YARN-3100: --- Allen, thanks for your comments. This jira also includes

[jira] [Commented] (YARN-1743) Decorate event transitions and the event-types with their behaviour

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292803#comment-14292803 ] Hadoop QA commented on YARN-1743: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2718) Create a CompositeConatainerExecutor that combines DockerContainerExecutor and DefaultContainerExecutor

2015-01-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292909#comment-14292909 ] Allen Wittenauer commented on YARN-2718: IMO, this jira should get closed in favor

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-26 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293090#comment-14293090 ] Varun Saxena commented on YARN-3075: [~leftnoteasy], for other review comments. bq. 2)

[jira] [Commented] (YARN-3025) Provide API for retrieving blacklisted nodes

2015-01-26 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292973#comment-14292973 ] Tsuyoshi OZAWA commented on YARN-3025: -- {quote} Lets say 1000 AMs pinging every 1 sec.

[jira] [Commented] (YARN-3011) NM dies because of the failure of resource localization

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292800#comment-14292800 ] Hadoop QA commented on YARN-3011: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3099) Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label.

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292821#comment-14292821 ] Hadoop QA commented on YARN-3099: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2718) Create a CompositeConatainerExecutor that combines DockerContainerExecutor and DefaultContainerExecutor

2015-01-26 Thread Leitao Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292910#comment-14292910 ] Leitao Guo commented on YARN-2718: -- [~chenchun], in the following codes, I think you

[jira] [Commented] (YARN-2992) ZKRMStateStore crashes due to session expiry

2015-01-26 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292937#comment-14292937 ] Chun Chen commented on YARN-2992: - [~kasha] [~rohithsharma] [~jianhe], we are constantly

[jira] [Updated] (YARN-3101) FairScheduler#fitInMaxShare was added to validate reservations but it does not consider it

2015-01-26 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3101: Attachment: YARN-3101.001.patch Fixes the issue Verified the test passes

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-01-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293015#comment-14293015 ] Allen Wittenauer commented on YARN-3100: It sounds like this JIRA should get split

[jira] [Comment Edited] (YARN-3100) Make YARN authorization pluggable

2015-01-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293015#comment-14293015 ] Allen Wittenauer edited comment on YARN-3100 at 1/27/15 5:57 AM:

[jira] [Commented] (YARN-3025) Provide API for retrieving blacklisted nodes

2015-01-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292981#comment-14292981 ] Ted Yu commented on YARN-3025: -- Tsuyoshi's comment makes sense. Provide API for retrieving

[jira] [Commented] (YARN-3079) Scheduler should also update maximumAllocation when updateNodeResource.

2015-01-26 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293108#comment-14293108 ] zhihai xu commented on YARN-3079: - thanks [~rchiang] and [~leftnoteasy]'s review. bq. IMHO,

[jira] [Commented] (YARN-3011) NM dies because of the failure of resource localization

2015-01-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292674#comment-14292674 ] Jian He commented on YARN-3011: --- [~varun_saxena], I tried to commit, but patch seems not

[jira] [Commented] (YARN-3079) Scheduler should also update maximumAllocation when updateNodeResource.

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292729#comment-14292729 ] Wangda Tan commented on YARN-3079: -- [~zxu], Thanks for reply, bq. This is discussable. I

[jira] [Updated] (YARN-3011) NM dies because of the failure of resource localization

2015-01-26 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3011: --- Attachment: YARN-3011.003.patch NM dies because of the failure of resource localization

[jira] [Commented] (YARN-3098) Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292738#comment-14292738 ] Hadoop QA commented on YARN-3098: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-01-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292747#comment-14292747 ] Allen Wittenauer commented on YARN-3100: This sounds like something that should

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292755#comment-14292755 ] Wangda Tan commented on YARN-3075: -- You're right, I mis-read your test :). Besides 6), I

[jira] [Commented] (YARN-2718) Create a CompositeConatainerExecutor that combines DockerContainerExecutor and DefaultContainerExecutor

2015-01-26 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292903#comment-14292903 ] Chun Chen commented on YARN-2718: - Well, The patch I've uploaded mainly focuses on making

[jira] [Commented] (YARN-3101) FairScheduler#fitInMaxShare was added to validate reservations but it does not consider it

2015-01-26 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293010#comment-14293010 ] Anubhav Dhoot commented on YARN-3101: - [~sandyr] [~l201514] appreciate your review

[jira] [Commented] (YARN-1983) Support heterogeneous container types at runtime on YARN

2015-01-26 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293060#comment-14293060 ] Chun Chen commented on YARN-1983: - Attach a patch which creates a

[jira] [Commented] (YARN-3079) Scheduler should also update maximumAllocation when updateNodeResource.

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293141#comment-14293141 ] Hadoop QA commented on YARN-3079: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3024) LocalizerRunner should give DIE action when all resources are localized

2015-01-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291717#comment-14291717 ] Hudson commented on YARN-3024: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #85 (See

[jira] [Commented] (YARN-41) The RM should handle the graceful shutdown of the NM.

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291727#comment-14291727 ] Hadoop QA commented on YARN-41: --- {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3024) LocalizerRunner should give DIE action when all resources are localized

2015-01-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291731#comment-14291731 ] Hudson commented on YARN-3024: -- FAILURE: Integrated in Hadoop-Yarn-trunk #819 (See

[jira] [Commented] (YARN-2390) Investigating whether generic history service needs to support queue-acls

2015-01-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291746#comment-14291746 ] Sunil G commented on YARN-2390: --- HI [~zjshen] Are we still focusing on this JIRA? Kindly

[jira] [Commented] (YARN-3093) Support load command from admin [Helps to load big set of labels]

2015-01-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14291750#comment-14291750 ] Sunil G commented on YARN-3093: --- Thank you [~rohithsharma] and [~leftnoteasy] I was thinking

[jira] [Updated] (YARN-2808) yarn client tool can not list app_attempt's container info correctly

2015-01-26 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2808: Attachment: YARN-2808.20150126-1.patch Hi [~zjshen], As discussed unifying the container

[jira] [Commented] (YARN-2875) Bump SLF4J to 1.7.7 from 1.7.5

2015-01-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292529#comment-14292529 ] Steve Loughran commented on YARN-2875: -- tim, add a patch in HADOOP-11317 to

[jira] [Commented] (YARN-3098) Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292548#comment-14292548 ] Hadoop QA commented on YARN-3098: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2683) registry config options: document and move to core-default

2015-01-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292546#comment-14292546 ] Steve Loughran commented on YARN-2683: -- security: there's a special bit for automatic

[jira] [Updated] (YARN-3099) Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label.

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3099: - Summary: Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track

[jira] [Updated] (YARN-3099) Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label.

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3099: - Attachment: YARN-3099.1.patch Attached ver.1 patch, since YARN-3092 is not committed, included YARN-3092

[jira] [Updated] (YARN-3099) Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label.

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3099: - Description: After YARN-3092, resource-by-label (include

[jira] [Updated] (YARN-3098) Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3098: - Attachment: YARN-3098.2.patch Thanks for review, [~jianhe]. Addressed all comments and attached new patch.

[jira] [Commented] (YARN-3022) Expose Container resource information from NodeManager for monitoring

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292604#comment-14292604 ] Hadoop QA commented on YARN-3022: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292520#comment-14292520 ] Hadoop QA commented on YARN-3075: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2897) CrossOriginFilter needs more log statements

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292532#comment-14292532 ] Hadoop QA commented on YARN-2897: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3098) Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292550#comment-14292550 ] Wangda Tan commented on YARN-3098: -- Failed test is not related to this patch. Create

[jira] [Commented] (YARN-3098) Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues

2015-01-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292566#comment-14292566 ] Jian He commented on YARN-3098: --- - maybe a bug ? it's internally using NL {code} public

[jira] [Commented] (YARN-3092) Create common ResourceUsage class to track labeled resource usages in Capacity Scheduler

2015-01-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292642#comment-14292642 ] Hudson commented on YARN-3092: -- FAILURE: Integrated in Hadoop-trunk-Commit #6936 (See

[jira] [Updated] (YARN-3098) Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3098: - Attachment: YARN-3098.3.patch Make code style consistent with YARN-3092 Create common QueueCapacities

[jira] [Updated] (YARN-3098) Create common QueueCapacities class in Capacity Scheduler to track capacities-by-labels of queues

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3098: - Attachment: YARN-3098.4.patch Create common QueueCapacities class in Capacity Scheduler to track

[jira] [Commented] (YARN-3099) Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label.

2015-01-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292685#comment-14292685 ] Hadoop QA commented on YARN-3099: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3099) Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label.

2015-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3099: - Attachment: YARN-3099.2.patch Since YARN-3092 is just committed, rebased patch against trunk. (ver.2)

[jira] [Commented] (YARN-3075) NodeLabelsManager implementation to retrieve label to node mapping

2015-01-26 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292697#comment-14292697 ] Varun Saxena commented on YARN-3075: [~leftnoteasy], bq. This seems not correct to me.

  1   2   >