[jira] [Updated] (YARN-1609) Add Service Container type to NodeManager in YARN

2015-03-09 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated YARN-1609: - Assignee: (was: Jeff Zhang) > Add Service Container type to NodeManager in YARN > -

[jira] [Updated] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-03-09 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-3225: Attachment: YARN-914.patch > New parameter or CLI for decommissioning node gracefully in RMAdmin CLI > --

[jira] [Commented] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352766#comment-14352766 ] Hadoop QA commented on YARN-3225: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3296) yarn.nodemanager.container-monitor.process-tree.class is configurable but ResourceCalculatorProcessTree class is marked Private

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352835#comment-14352835 ] Hudson commented on YARN-3296: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #127 (See [htt

[jira] [Commented] (YARN-3296) yarn.nodemanager.container-monitor.process-tree.class is configurable but ResourceCalculatorProcessTree class is marked Private

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352857#comment-14352857 ] Hudson commented on YARN-3296: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #861 (See [https://b

[jira] [Commented] (YARN-3296) yarn.nodemanager.container-monitor.process-tree.class is configurable but ResourceCalculatorProcessTree class is marked Private

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352863#comment-14352863 ] Hudson commented on YARN-3296: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2059 (See [https://

[jira] [Commented] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-03-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352944#comment-14352944 ] Junping Du commented on YARN-3225: -- Thanks [~devaraj.k] for delivering the patch which is

[jira] [Updated] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-03-09 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-3225: Attachment: YARN-3225.patch > New parameter or CLI for decommissioning node gracefully in RMAdmin CLI > -

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352962#comment-14352962 ] Junping Du commented on YARN-3304: -- Agree that negative value sounds very odd. However, if

[jira] [Commented] (YARN-3298) User-limit should be enforced in CapacityScheduler

2015-03-09 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353053#comment-14353053 ] Nathan Roberts commented on YARN-3298: -- Thanks [~leftnoteasy] for the additional detai

[jira] [Commented] (YARN-3296) yarn.nodemanager.container-monitor.process-tree.class is configurable but ResourceCalculatorProcessTree class is marked Private

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353071#comment-14353071 ] Hudson commented on YARN-3296: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #118 (See [htt

[jira] [Commented] (YARN-3296) yarn.nodemanager.container-monitor.process-tree.class is configurable but ResourceCalculatorProcessTree class is marked Private

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353095#comment-14353095 ] Hudson commented on YARN-3296: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #127 (See

[jira] [Updated] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-09 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2495: Attachment: YARN-2495.20150309-1.patch Hi [~wangda], Attaching the updated patch and find th

[jira] [Commented] (YARN-3296) yarn.nodemanager.container-monitor.process-tree.class is configurable but ResourceCalculatorProcessTree class is marked Private

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353127#comment-14353127 ] Hudson commented on YARN-3296: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2077 (See [htt

[jira] [Updated] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-03-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3136: -- Attachment: 0006-YARN-3136.patch > getTransferredContainers can be a bottleneck during AM registration >

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-03-09 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353143#comment-14353143 ] Sunil G commented on YARN-3136: --- bq.createReleaseCache schedules a timer task that Sorry. I a

[jira] [Updated] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-03-09 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2729: Attachment: YARN-2729.20150309-1.patch Hi [~wangda] Rebasing the patch Removing dependency o

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353217#comment-14353217 ] Hadoop QA commented on YARN-2495: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353232#comment-14353232 ] Hadoop QA commented on YARN-3136: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-09 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353241#comment-14353241 ] Naganarasimha G R commented on YARN-2495: - Most of the find bugs reported are from

[jira] [Commented] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-03-09 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353259#comment-14353259 ] Jonathan Eagles commented on YARN-3287: --- [~zjshen], can you have another looks now th

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-09 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353272#comment-14353272 ] Anubhav Dhoot commented on YARN-3304: - The intention of setting -1 as was for this issu

[jira] [Created] (YARN-3306) [Umbrella] Proposing per-queue Policy driven scheduling in YARN

2015-03-09 Thread Vinod Kumar Vavilapalli (JIRA)
Vinod Kumar Vavilapalli created YARN-3306: - Summary: [Umbrella] Proposing per-queue Policy driven scheduling in YARN Key: YARN-3306 URL: https://issues.apache.org/jira/browse/YARN-3306 Project

[jira] [Commented] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-03-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353277#comment-14353277 ] Zhijie Shen commented on YARN-3287: --- Sure, I'll take a look again. > TimelineClient kerb

[jira] [Updated] (YARN-3306) [Umbrella] Proposing per-queue Policy driven scheduling in YARN

2015-03-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3306: -- Attachment: PerQueuePolicydrivenschedulinginYARN.pdf Here's a detailed proposal d

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353353#comment-14353353 ] Wangda Tan commented on YARN-2495: -- For your comments: 1) For the name, do you think is se

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353383#comment-14353383 ] Vinod Kumar Vavilapalli commented on YARN-2495: --- Quick comments - configurat

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2015-03-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353390#comment-14353390 ] Vinod Kumar Vavilapalli commented on YARN-1963: --- {quote} As per discussion ha

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-09 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353397#comment-14353397 ] Craig Welch commented on YARN-2495: --- -re bq. How about we simply things? Instead of acce

[jira] [Commented] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-03-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353418#comment-14353418 ] Zhijie Shen commented on YARN-3287: --- I double checked the oozie use case. It seems that f

[jira] [Updated] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-03-09 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-3287: -- Attachment: YARN-3287.3.patch [~zjshen], trying to unwrap as before. Let me know if this is what

[jira] [Moved] (YARN-3307) Master-Worker Application on YARN

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-3315 to YARN-3307: --- Affects Version/s: (was: 3.0.0) 3.0.

[jira] [Commented] (YARN-3298) User-limit should be enforced in CapacityScheduler

2015-03-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353553#comment-14353553 ] Wangda Tan commented on YARN-3298: -- Hi [~nroberts], If I understand what you meant correct

[jira] [Commented] (YARN-1884) ContainerReport should have nodeHttpAddress

2015-03-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353558#comment-14353558 ] Zhijie Shen commented on YARN-1884: --- [~xgong], thanks for the patch. Here're some comment

[jira] [Updated] (YARN-3308) Improvements to CapacityScheduler documentation

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-3308: --- Release Note: (was: documentation change only) > Improvements to CapacityScheduler documentat

[jira] [Updated] (YARN-3308) Improvements to CapacityScheduler documentation

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-3308: --- Affects Version/s: 3.0.0 > Improvements to CapacityScheduler documentation > --

[jira] [Moved] (YARN-3308) Improvements to CapacityScheduler documentation

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-3658 to YARN-3308: --- Component/s: (was: mrv2) docum

[jira] [Commented] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-03-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353574#comment-14353574 ] Zhijie Shen commented on YARN-3287: --- +1 for the last patch. Will commit it. > TimelineCl

[jira] [Commented] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353560#comment-14353560 ] Hadoop QA commented on YARN-3287: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353597#comment-14353597 ] Hudson commented on YARN-3287: -- FAILURE: Integrated in Hadoop-trunk-Commit #7291 (See [https:

[jira] [Created] (YARN-3309) Capacity scheduler can wait a very long time for node locality

2015-03-09 Thread Nathan Roberts (JIRA)
Nathan Roberts created YARN-3309: Summary: Capacity scheduler can wait a very long time for node locality Key: YARN-3309 URL: https://issues.apache.org/jira/browse/YARN-3309 Project: Hadoop YARN

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-09 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353639#comment-14353639 ] Vinod Kumar Vavilapalli commented on YARN-2495: --- Ah, right. Forgot about that

[jira] [Updated] (YARN-3308) Improvements to CapacityScheduler documentation

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-3308: --- Attachment: YARN-3308-02.patch 02: * rebased for trunk * took in arun's comments > Improvement

[jira] [Moved] (YARN-3310) MR-279: Log info about the location of dist cache

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-2758 to YARN-3310: --- Component/s: (was: mrv2) Affects Version/s: (

[jira] [Moved] (YARN-3313) Write additional tests for data locality in MRv2.

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-3093 to YARN-3313: --- Component/s: (was: mrv2) (

[jira] [Moved] (YARN-3312) Web UI menu inconsistencies

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-3075 to YARN-3312: --- Component/s: (was: mrv2) Affects Version/s: (

[jira] [Moved] (YARN-3314) Write an integration test for validating MR AM restart and recovery

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-3245 to YARN-3314: --- Component/s: (was: mrv2) (

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2015-03-09 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353677#comment-14353677 ] Nathan Roberts commented on YARN-1963: -- {quote} Without some sort of labels, it will b

[jira] [Moved] (YARN-3315) Fix -list-blacklisted-trackers to print the blacklisted NMs

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-3305 to YARN-3315: --- Component/s: (was: mrv2) Affects Version/s: (

[jira] [Moved] (YARN-3311) add location to web UI so you know where you are - cluster, node, AM, job history

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-3074 to YARN-3311: --- Component/s: (was: mrv2) Affects Version/s: (

[jira] [Commented] (YARN-3243) CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

2015-03-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353704#comment-14353704 ] Jian He commented on YARN-3243: --- thanks Wangda ! - ParentQueue#canAssignToThisQueue, {code}

[jira] [Moved] (YARN-3316) Make the ResourceManager, NodeManager and HistoryServer run from Eclipse.

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-2798 to YARN-3316: --- Component/s: (was: mrv2) Affects Version/s: (

[jira] [Updated] (YARN-3316) Make the ResourceManager, NodeManager and HistoryServer run from Eclipse.

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-3316: --- Component/s: resourcemanager nodemanager > Make the ResourceManager, NodeManag

[jira] [Commented] (YARN-3273) Improve web UI to facilitate scheduling analysis and debugging

2015-03-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353787#comment-14353787 ] Jian He commented on YARN-3273: --- looks good, to distinguish scenarios like one user belongs t

[jira] [Commented] (YARN-3215) Respect labels in CapacityScheduler when computing headroom

2015-03-09 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353800#comment-14353800 ] Nathan Roberts commented on YARN-3215: -- Hi [~leftnoteasy]. Can you provide a summary o

[jira] [Commented] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-03-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353803#comment-14353803 ] Zhijie Shen commented on YARN-3287: --- Merge it into branch-2.7 too. > TimelineClient kerb

[jira] [Commented] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-03-09 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353815#comment-14353815 ] Jonathan Eagles commented on YARN-3287: --- Thanks, [~zjshen] > TimelineClient kerberos

[jira] [Commented] (YARN-321) Generic application history service

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353825#comment-14353825 ] Allen Wittenauer commented on YARN-321: --- Looks like this should get closed out w/a fix

[jira] [Commented] (YARN-3298) User-limit should be enforced in CapacityScheduler

2015-03-09 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353833#comment-14353833 ] Nathan Roberts commented on YARN-3298: -- [~leftnoteasy], won't that be extremely close

[jira] [Moved] (YARN-3317) MR-279: Modularize web framework and webapps

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-2435 to YARN-3317: --- Tags: (was: mrv2, hamlet, module) Component/s:

[jira] [Updated] (YARN-1884) ContainerReport should have nodeHttpAddress

2015-03-09 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1884: Attachment: YARN-1884.2.patch > ContainerReport should have nodeHttpAddress > ---

[jira] [Commented] (YARN-3298) User-limit should be enforced in CapacityScheduler

2015-03-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353852#comment-14353852 ] Wangda Tan commented on YARN-3298: -- [~nroberts], As you mentioned, it is mostly as same as

[jira] [Commented] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2015-03-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353853#comment-14353853 ] Sangjin Lee commented on YARN-2928: --- I suppose the "ApplicationMaster events" refer to th

[jira] [Commented] (YARN-1884) ContainerReport should have nodeHttpAddress

2015-03-09 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353864#comment-14353864 ] Xuan Gong commented on YARN-1884: - The new patch addressed all the comments > ContainerRep

[jira] [Commented] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2015-03-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353872#comment-14353872 ] Sangjin Lee commented on YARN-2928: --- A couple of more comments on the plan: - I think th

[jira] [Commented] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2015-03-09 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353882#comment-14353882 ] Robert Kanter commented on YARN-2928: - I agree; we're using "aggregator" for too many t

[jira] [Updated] (YARN-3215) Respect labels in CapacityScheduler when computing headroom

2015-03-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3215: - Description: In existing CapacityScheduler, when computing headroom of an application, it will only consid

[jira] [Commented] (YARN-3215) Respect labels in CapacityScheduler when computing headroom

2015-03-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353891#comment-14353891 ] Wangda Tan commented on YARN-3215: -- Yes, it works for no-labeled environment only, I added

[jira] [Commented] (YARN-3215) Respect labels in CapacityScheduler when computing headroom

2015-03-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353890#comment-14353890 ] Wangda Tan commented on YARN-3215: -- Yes, it works for no-labeled environment only, I added

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353897#comment-14353897 ] Wangda Tan commented on YARN-2495: -- I think the two issues are identical, and we should ha

[jira] [Commented] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2015-03-09 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353895#comment-14353895 ] Vrushali C commented on YARN-2928: -- + 1 to renaming TimelineAggregator. TimelineReceiver

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-09 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353928#comment-14353928 ] Craig Welch commented on YARN-2495: --- I understand the desire for fail-fast behavior to in

[jira] [Created] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-03-09 Thread Craig Welch (JIRA)
Craig Welch created YARN-3318: - Summary: Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior Key: YARN-3318 URL: https://issues.apache.org/jira/browse/YARN-3

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-03-09 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353953#comment-14353953 ] Craig Welch commented on YARN-3318: --- Proposed elements of the framework: A SchedulerPro

[jira] [Assigned] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-03-09 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch reassigned YARN-3318: - Assignee: Craig Welch > Create Initial OrderingPolicy Framework, integrate with CapacityScheduler

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-03-09 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353965#comment-14353965 ] Craig Welch commented on YARN-3318: --- The proposed initial implementation of the framewor

[jira] [Updated] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-03-09 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3318: -- Attachment: YARN-3318.13.patch Initial, incomplete patch with the overall framework & implementation of

[jira] [Commented] (YARN-3300) outstanding_resource_requests table should not be shown in AHS

2015-03-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353990#comment-14353990 ] Jian He commented on YARN-3300: --- lgtm, +1 > outstanding_resource_requests table should not

[jira] [Created] (YARN-3319) Implement a Fair SchedulerOrderingPolicy

2015-03-09 Thread Craig Welch (JIRA)
Craig Welch created YARN-3319: - Summary: Implement a Fair SchedulerOrderingPolicy Key: YARN-3319 URL: https://issues.apache.org/jira/browse/YARN-3319 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2015-03-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354003#comment-14354003 ] Karthik Kambatla commented on YARN-2928: +1 to renaming. Prefer - TimelineCollect

[jira] [Commented] (YARN-3300) outstanding_resource_requests table should not be shown in AHS

2015-03-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354005#comment-14354005 ] Jian He commented on YARN-3300: --- actually, after looking at the UI, on app page, there's a bi

[jira] [Commented] (YARN-3319) Implement a Fair SchedulerOrderingPolicy

2015-03-09 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354006#comment-14354006 ] Craig Welch commented on YARN-3319: --- Initially this will be implemented for SchedulerAppl

[jira] [Updated] (YARN-3319) Implement a Fair SchedulerOrderingPolicy

2015-03-09 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.13.patch Attaching initial/incomplete patch, it depends on the [YARN-3318] patch of

[jira] [Updated] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-03-09 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3318: -- Attachment: YARN-3318.14.patch Same as .13 except it should be possible to apply with [YARN-3319] 's .14

[jira] [Updated] (YARN-3319) Implement a Fair SchedulerOrderingPolicy

2015-03-09 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.14.patch Same as .13, except it should be possible to apply this patch after applyi

[jira] [Commented] (YARN-1884) ContainerReport should have nodeHttpAddress

2015-03-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354029#comment-14354029 ] Hadoop QA commented on YARN-1884: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (YARN-3320) Support a Priority SchedulerOrderingPolicy composible with Fair and Fifo ordering

2015-03-09 Thread Craig Welch (JIRA)
Craig Welch created YARN-3320: - Summary: Support a Priority SchedulerOrderingPolicy composible with Fair and Fifo ordering Key: YARN-3320 URL: https://issues.apache.org/jira/browse/YARN-3320 Project: Hado

[jira] [Updated] (YARN-3320) Support a Priority OrderingPolicy

2015-03-09 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3320: -- Summary: Support a Priority OrderingPolicy (was: Support a Priority SchedulerOrderingPolicy composible w

[jira] [Commented] (YARN-3320) Support a Priority OrderingPolicy

2015-03-09 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354035#comment-14354035 ] Craig Welch commented on YARN-3320: --- The initial intent is to bring the appropriate parts

[jira] [Moved] (YARN-3321) "Health-Report" column of NodePage should display more information.

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-3091 to YARN-3321: --- Component/s: (was: nodemanager)

[jira] [Commented] (YARN-3300) outstanding_resource_requests table should not be shown in AHS

2015-03-09 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354126#comment-14354126 ] Xuan Gong commented on YARN-3300: - bq. actually, after looking at the UI, on app page, ther

[jira] [Moved] (YARN-3322) RM/AM/JHS webservers should return HTTP.BadRequest for malformed requests and not HTTP.NotFound

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer moved MAPREDUCE-3923 to YARN-3322: --- Component/s: (was: webapps)

[jira] [Updated] (YARN-3111) Fix ratio problem on FairScheduler page

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-3111: --- Fix Version/s: (was: 2.7.0) > Fix ratio problem on FairScheduler page > ---

[jira] [Updated] (YARN-3187) Documentation of Capacity Scheduler Queue mapping based on user or group

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-3187: --- Fix Version/s: (was: 2.6.0) > Documentation of Capacity Scheduler Queue mapping based on us

[jira] [Updated] (YARN-2902) Killing a container that is localizing can orphan resources in the DOWNLOADING state

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2902: --- Fix Version/s: (was: 2.7.0) > Killing a container that is localizing can orphan resources i

[jira] [Updated] (YARN-3200) Factor OSType out from Shell: changes in YARN

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-3200: --- Fix Version/s: (was: 2.7.0) > Factor OSType out from Shell: changes in YARN > -

[jira] [Updated] (YARN-1142) MiniYARNCluster web ui does not work properly

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-1142: --- Fix Version/s: (was: 2.7.0) > MiniYARNCluster web ui does not work properly > -

[jira] [Commented] (YARN-3300) outstanding_resource_requests table should not be shown in AHS

2015-03-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354227#comment-14354227 ] Jian He commented on YARN-3300: --- sounds good. committing > outstanding_resource_requests ta

[jira] [Updated] (YARN-160) nodemanagers should obtain cpu/memory values from underlying OS

2015-03-09 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-160: -- Fix Version/s: (was: 2.7.0) > nodemanagers should obtain cpu/memory values from underlying OS

[jira] [Commented] (YARN-3300) outstanding_resource_requests table should not be shown in AHS

2015-03-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14354236#comment-14354236 ] Hudson commented on YARN-3300: -- FAILURE: Integrated in Hadoop-trunk-Commit #7293 (See [https:

  1   2   >