[jira] [Updated] (YARN-276) Capacity Scheduler can hang when submit many jobs concurrently

2013-06-13 Thread nemon lou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nemon lou updated YARN-276: --- Attachment: YARN-276.patch Many test cases(both in YARN and MapReduce project) will fail because we have a mor

[jira] [Resolved] (YARN-812) Enabling app summary logs causes 'FileNotFound' errors

2013-06-13 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved YARN-812. Resolution: Fixed Fix Version/s: 2.1.0-beta I just committed this. Thanks Sid!

[jira] [Commented] (YARN-802) APPLICATION_INIT is never sent to AuxServices other than the builtin ShuffleHandler

2013-06-13 Thread Avner BenHanoch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683102#comment-13683102 ] Avner BenHanoch commented on YARN-802: -- This idea will force us to restart mapred daemo

[jira] [Commented] (YARN-812) Enabling app summary logs causes 'FileNotFound' errors

2013-06-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683087#comment-13683087 ] Zhijie Shen commented on YARN-812: -- +1 for the patch. One related question. Does "hadoop.m

[jira] [Created] (YARN-818) YARN application classpath should add $PWD/* in addition to $PWD

2013-06-13 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-818: --- Summary: YARN application classpath should add $PWD/* in addition to $PWD Key: YARN-818 URL: https://issues.apache.org/jira/browse/YARN-818 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-291) Dynamic resource configuration

2013-06-13 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683050#comment-13683050 ] Alejandro Abdelnur commented on YARN-291: - [~djp], in a host you could typically hav

[jira] [Commented] (YARN-311) Dynamic node resource configuration: core scheduler changes

2013-06-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683044#comment-13683044 ] Junping Du commented on YARN-311: - According to discussion above, let's split JMX api into a

[jira] [Commented] (YARN-792) Move NodeHealthStatus from yarn.api.record to yarn.server.api.record

2013-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683043#comment-13683043 ] Hudson commented on YARN-792: - Integrated in Hadoop-trunk-Commit #3918 (See [https://builds.apa

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core scheduler changes

2013-06-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Summary: Dynamic node resource configuration: core scheduler changes (was: Dynamic node resource configurati

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core changes

2013-06-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Description: As the first step, we go for resource change on RM side and expose admin APIs (admin protocol,

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core changes

2013-06-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Description: As the first step, we go for resource change on RM side and expose admin APIs (admin protocol,

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core changes

2013-06-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Summary: Dynamic node resource configuration: core changes (was: Dynamic node resource configuration on RM w

[jira] [Moved] (YARN-817) If input path does not exist application/job id is getting assigned.

2013-06-13 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishan Shetty moved MAPREDUCE-5322 to YARN-817: --- Component/s: (was: resourcemanager) res

[jira] [Commented] (YARN-333) Schedulers cannot control the queue-name of an application

2013-06-13 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683032#comment-13683032 ] Alejandro Abdelnur commented on YARN-333: - +1, LGTM. > Schedulers c

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2013-06-13 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683029#comment-13683029 ] Alejandro Abdelnur commented on YARN-810: - IMO the settings to enable ceiling should

[jira] [Commented] (YARN-781) Expose LOGDIR that containers should use for logging

2013-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683028#comment-13683028 ] Hadoop QA commented on YARN-781: {color:green}+1 overall{color}. Here are the results of te

[jira] [Commented] (YARN-333) Schedulers cannot control the queue-name of an application

2013-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683027#comment-13683027 ] Hadoop QA commented on YARN-333: {color:green}+1 overall{color}. Here are the results of te

[jira] [Commented] (YARN-782) vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way

2013-06-13 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683026#comment-13683026 ] Alejandro Abdelnur commented on YARN-782: - +1. good catch. > vcore

[jira] [Commented] (YARN-291) Dynamic resource configuration

2013-06-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683024#comment-13683024 ] Junping Du commented on YARN-291: - I think we are just not sure if non-yarn process is still

[jira] [Updated] (YARN-812) Enabling app summary logs causes 'FileNotFound' errors

2013-06-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated YARN-812: Attachment: YARN-812.2.txt Updated the patch to uncomment the lines. Don't think that needs a separat

[jira] [Commented] (YARN-782) vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way

2013-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683018#comment-13683018 ] Hadoop QA commented on YARN-782: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-588) Two identical utility methods in different classes to build Resource

2013-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683017#comment-13683017 ] Hadoop QA commented on YARN-588: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-806) Move ContainerExitStatus from yarn.api to yarn.api.records

2013-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683016#comment-13683016 ] Hadoop QA commented on YARN-806: {color:green}+1 overall{color}. Here are the results of te

[jira] [Updated] (YARN-781) Expose LOGDIR that containers should use for logging

2013-06-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-781: - Attachment: YARN-781.patch Patch, set the final LOG_DIR into container's env and add a test. > Exp

[jira] [Assigned] (YARN-781) Expose LOGDIR that containers should use for logging

2013-06-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-781: Assignee: Jian He (was: Vinod Kumar Vavilapalli) > Expose LOGDIR that containers should use for logging

[jira] [Commented] (YARN-792) Move NodeHealthStatus from yarn.api.record to yarn.server.api.record

2013-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683007#comment-13683007 ] Hadoop QA commented on YARN-792: {color:green}+1 overall{color}. Here are the results of te

[jira] [Commented] (YARN-792) Move NodeHealthStatus from yarn.api.record to yarn.server.api.record

2013-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683003#comment-13683003 ] Hadoop QA commented on YARN-792: {color:green}+1 overall{color}. Here are the results of te

[jira] [Commented] (YARN-812) Enabling app summary logs causes 'FileNotFound' errors

2013-06-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682987#comment-13682987 ] Vinod Kumar Vavilapalli commented on YARN-812: -- Not related to your patch, but

[jira] [Commented] (YARN-782) vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682981#comment-13682981 ] Sandy Ryza commented on YARN-782: - Updated patch to change yarn.nodemanager.resource.cpu-cor

[jira] [Updated] (YARN-782) vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-782: Attachment: YARN-782-1.patch > vcores-pcores ratio functions differently from vmem-pmem ratio in misleadi

[jira] [Commented] (YARN-812) Enabling app summary logs causes 'FileNotFound' errors

2013-06-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682980#comment-13682980 ] Hitesh Shah commented on YARN-812: -- +1. Explanation seems fine to me. > En

[jira] [Updated] (YARN-812) Enabling app summary logs causes 'FileNotFound' errors

2013-06-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated YARN-812: Target Version/s: 2.1.0-beta Fix Version/s: (was: 2.1.0-beta) > Enabling app summary l

[jira] [Created] (YARN-816) Implement AM recovery for distributed shell

2013-06-13 Thread Vinod Kumar Vavilapalli (JIRA)
Vinod Kumar Vavilapalli created YARN-816: Summary: Implement AM recovery for distributed shell Key: YARN-816 URL: https://issues.apache.org/jira/browse/YARN-816 Project: Hadoop YARN I

[jira] [Assigned] (YARN-815) Add container failure handling to distributed-shell

2013-06-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reassigned YARN-815: Assignee: (was: Vinod Kumar Vavilapalli) > Add container failure hand

[jira] [Created] (YARN-815) Add container failure handling to distributed-shell

2013-06-13 Thread Vinod Kumar Vavilapalli (JIRA)
Vinod Kumar Vavilapalli created YARN-815: Summary: Add container failure handling to distributed-shell Key: YARN-815 URL: https://issues.apache.org/jira/browse/YARN-815 Project: Hadoop YARN

[jira] [Updated] (YARN-522) [Umbrella] Better reporting for crashed/Killed AMs/Containers

2013-06-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-522: - Summary: [Umbrella] Better reporting for crashed/Killed AMs/Containers (was: [Umbrella] Better reporting f

[jira] [Updated] (YARN-522) [Umbrella] Better reporting for crashed/Killed AMs and Containers

2013-06-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah updated YARN-522: - Summary: [Umbrella] Better reporting for crashed/Killed AMs and Containers (was: [Umbrella] Better reporti

[jira] [Created] (YARN-814) Difficult to diagnose a failed container launch when error due to invalid environment variable

2013-06-13 Thread Hitesh Shah (JIRA)
Hitesh Shah created YARN-814: Summary: Difficult to diagnose a failed container launch when error due to invalid environment variable Key: YARN-814 URL: https://issues.apache.org/jira/browse/YARN-814 Proj

[jira] [Updated] (YARN-812) Enabling app summary logs causes 'FileNotFound' errors

2013-06-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated YARN-812: Attachment: YARN-812.txt Patch changes the default appsummary logger to match hadoop.root.logger, whi

[jira] [Updated] (YARN-639) Make AM of Distributed Shell Use NMClient

2013-06-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-639: - Component/s: applications/distributed-shell > Make AM of Distributed Shell Use

[jira] [Assigned] (YARN-812) Enabling app summary logs causes 'FileNotFound' errors

2013-06-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned YARN-812: --- Assignee: Siddharth Seth > Enabling app summary logs causes 'FileNotFound' errors > ---

[jira] [Updated] (YARN-49) Improve distributed shell application to work on a secure cluster

2013-06-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-49?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-49: Component/s: applications/distributed-shell > Improve distributed shell applicatio

[jira] [Commented] (YARN-291) Dynamic resource configuration

2013-06-13 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682963#comment-13682963 ] Alejandro Abdelnur commented on YARN-291: - If the NM goes down, on restart the runni

[jira] [Updated] (YARN-792) Move NodeHealthStatus from yarn.api.record to yarn.server.api.record

2013-06-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-792: - Attachment: YARN-792.3.patch rebased. > Move NodeHealthStatus from yarn.api.record to yarn.server.

[jira] [Commented] (YARN-333) Schedulers cannot control the queue-name of an application

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682958#comment-13682958 ] Sandy Ryza commented on YARN-333: - Attached an updated patch that includes a test

[jira] [Updated] (YARN-333) Schedulers cannot control the queue-name of an application

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-333: Attachment: YARN-333-2.patch > Schedulers cannot control the queue-name of an application > -

[jira] [Moved] (YARN-813) Document and likewise implement relevant checks/escape functions for what form of input is acceptable for setting up a container launch context i.e. special chars in resource

2013-06-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Shah moved MAPREDUCE-3155 to YARN-813: - Tags: (was: mr2,mapreduce-2.0) Component/s: (wa

[jira] [Commented] (YARN-806) Move ContainerExitStatus from yarn.api to yarn.api.records

2013-06-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682951#comment-13682951 ] Jian He commented on YARN-806: -- simple eclipse move > Move ContainerExitStatu

[jira] [Updated] (YARN-806) Move ContainerExitStatus from yarn.api to yarn.api.records

2013-06-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-806: - Attachment: YARN-806.patch > Move ContainerExitStatus from yarn.api to yarn.api.records > -

[jira] [Commented] (YARN-588) Two identical utility methods in different classes to build Resource

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682947#comment-13682947 ] Sandy Ryza commented on YARN-588: - Jenkins should automatically run because the patch has be

[jira] [Commented] (YARN-588) Two identical utility methods in different classes to build Resource

2013-06-13 Thread Niranjan Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682944#comment-13682944 ] Niranjan Singh commented on YARN-588: - Someone please kick off Jenkins, want to see the

[jira] [Created] (YARN-812) Enabling app summary logs causes 'FileNotFound' errors

2013-06-13 Thread Ramya Sunil (JIRA)
Ramya Sunil created YARN-812: Summary: Enabling app summary logs causes 'FileNotFound' errors Key: YARN-812 URL: https://issues.apache.org/jira/browse/YARN-812 Project: Hadoop YARN Issue Type: Bu

[jira] [Commented] (YARN-291) Dynamic resource configuration

2013-06-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682936#comment-13682936 ] Junping Du commented on YARN-291: - Sure. I will add more unit tests later to cover this case

[jira] [Commented] (YARN-333) Schedulers cannot control the queue-name of an application

2013-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682932#comment-13682932 ] Hadoop QA commented on YARN-333: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-692) Creating NMToken master key on RM and sharing it with NM as a part of RM-NM heartbeat.

2013-06-13 Thread Hudson (JIRA)
Reporter: Omkar Vinit Joshi >Assignee: Omkar Vinit Joshi > Attachments: YARN-692.20130530.1.patch, YARN-692.20130530.2.patch, > YARN-692.20130531.1.patch, YARN-692.20130531.3.patch, > YARN-692.20130531.patch, YARN-692-20130611.patch, YARN-692-20130613.1.patc

[jira] [Updated] (YARN-588) Two identical utility methods in different classes to build Resource

2013-06-13 Thread Niranjan Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niranjan Singh updated YARN-588: Attachment: YARN-588.patch Removed the single-argument Resources#createResource > T

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682919#comment-13682919 ] Sandy Ryza commented on YARN-810: - Chris and I chatted about this offline to get on the same

[jira] [Commented] (YARN-333) Schedulers cannot control the queue-name of an application

2013-06-13 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682916#comment-13682916 ] Alejandro Abdelnur commented on YARN-333: - The approach on the latest patch is much

[jira] [Commented] (YARN-639) Make AM of Distributed Shell Use NMClient

2013-06-13 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682914#comment-13682914 ] Omkar Vinit Joshi commented on YARN-639: [~zjshen] looked at your patch... minor com

[jira] [Updated] (YARN-333) Schedulers cannot control the queue-name of an application

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-333: Attachment: YARN-333-1.patch > Schedulers cannot control the queue-name of an application > -

[jira] [Updated] (YARN-333) Schedulers cannot control the queue-name of an application

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-333: Attachment: (was: YARN-333-1.patch) > Schedulers cannot control the queue-name of an application > --

[jira] [Updated] (YARN-333) Schedulers cannot control the queue-name of an application

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-333: Attachment: YARN-333-1.patch > Schedulers cannot control the queue-name of an application > -

[jira] [Commented] (YARN-333) Schedulers cannot control the queue-name of an application

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682909#comment-13682909 ] Sandy Ryza commented on YARN-333: - Uploading a patch that adds a setQueue method to RMApp, a

[jira] [Commented] (YARN-692) Creating NMToken master key on RM and sharing it with NM as a part of RM-NM heartbeat.

2013-06-13 Thread Hadoop QA (JIRA)
;Assignee: Omkar Vinit Joshi > Attachments: YARN-692.20130530.1.patch, YARN-692.20130530.2.patch, > YARN-692.20130531.1.patch, YARN-692.20130531.3.patch, > YARN-692.20130531.patch, YARN-692-20130611.patch, YARN-692-20130613.1.patch, > YARN-692-20130613.patch >

[jira] [Commented] (YARN-773) Move YarnRuntimeException from package api.yarn to api.yarn.exceptions

2013-06-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682906#comment-13682906 ] Hudson commented on YARN-773: - Integrated in Hadoop-trunk-Commit #3916 (See [https://builds.apa

[jira] [Commented] (YARN-773) Move YarnRuntimeException from package api.yarn to api.yarn.exceptions

2013-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682885#comment-13682885 ] Hadoop QA commented on YARN-773: {color:green}+1 overall{color}. Here are the results of te

[jira] [Updated] (YARN-692) Creating NMToken master key on RM and sharing it with NM as a part of RM-NM heartbeat.

2013-06-13 Thread Omkar Vinit Joshi (JIRA)
N-692.20130531.patch, YARN-692-20130611.patch, YARN-692-20130613.1.patch, > YARN-692-20130613.patch > > > This is related to YARN-613 . Here we will be implementing NMToken generation > on RM side and sharing it with NM during RM-NM heartbeat. As a part of this > JIRA mater k

[jira] [Commented] (YARN-588) Two identical utility methods in different classes to build Resource

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682866#comment-13682866 ] Sandy Ryza commented on YARN-588: - In the last case, using 1 will preserve the existing beha

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2013-06-13 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682858#comment-13682858 ] Chris Riccomini commented on YARN-810: -- Hey Sandy, Ah ha. Fair enough. But, then I thi

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682849#comment-13682849 ] Sandy Ryza commented on YARN-810: - Regarding, hz vs. virtual cores, there was some discussio

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2013-06-13 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682847#comment-13682847 ] Arun C Murthy commented on YARN-796: {quote} Labels are resources which max=1 and a tota

[jira] [Commented] (YARN-811) Add a set of final _init/_start/_stop methods to CompositeService

2013-06-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682846#comment-13682846 ] Siddharth Seth commented on YARN-811: - Trying to do this would probably mean that Abstra

[jira] [Updated] (YARN-694) AM uses the NMToken to authenticate all communication with NM. NM remembers and updates token across RM restart

2013-06-13 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-694: --- Attachment: YARN-694-20130613.patch > AM uses the NMToken to authenticate

[jira] [Commented] (YARN-588) Two identical utility methods in different classes to build Resource

2013-06-13 Thread Niranjan Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682841#comment-13682841 ] Niranjan Singh commented on YARN-588: - As of now I have not removed the single-argument

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2013-06-13 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682838#comment-13682838 ] Chris Riccomini commented on YARN-810: -- Hey Sandy, It's unclear to me why we'd need vc

[jira] [Commented] (YARN-811) Add a set of final _init/_start/_stop methods to CompositeService

2013-06-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682832#comment-13682832 ] Steve Loughran commented on YARN-811: - {{CompositeService extends AbstractServoce}}, thi

[jira] [Commented] (YARN-773) Move YarnRuntimeException from package api.yarn to api.yarn.exceptions

2013-06-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682833#comment-13682833 ] Vinod Kumar Vavilapalli commented on YARN-773: -- Looks good, straightforward mov

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682831#comment-13682831 ] Sandy Ryza commented on YARN-810: - Does it make more sense with the updated (correct) ratio

[jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

2013-06-13 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682830#comment-13682830 ] Arun C Murthy commented on YARN-807: +1 > When querying apps by queue,

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2013-06-13 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682827#comment-13682827 ] Chris Riccomini commented on YARN-810: -- Hey Sandy, What about just: {noformat} yarn.n

[jira] [Commented] (YARN-588) Two identical utility methods in different classes to build Resource

2013-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682829#comment-13682829 ] Hadoop QA commented on YARN-588: {color:green}+1 overall{color}. Here are the results of te

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2013-06-13 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682825#comment-13682825 ] Chris Riccomini commented on YARN-810: -- Hey Sandy, I'm with you up until this line: b

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682824#comment-13682824 ] Sandy Ryza commented on YARN-810: - Sorry, the ratio in my last comment should be (container'

[jira] [Created] (YARN-811) Add a set of final _init/_start/_stop methods to CompositeService

2013-06-13 Thread Siddharth Seth (JIRA)
Siddharth Seth created YARN-811: --- Summary: Add a set of final _init/_start/_stop methods to CompositeService Key: YARN-811 URL: https://issues.apache.org/jira/browse/YARN-811 Project: Hadoop YARN

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682821#comment-13682821 ] Sandy Ryza commented on YARN-810: - I've thought about this a little more. What seems prefer

[jira] [Assigned] (YARN-809) Enable better parallelism in the Fair Scheduler

2013-06-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-809: - Assignee: Karthik Kambatla (was: Sandy Ryza) > Enable better parallelism in the Fair S

[jira] [Commented] (YARN-694) AM uses the NMToken to authenticate all communication with NM. NM remembers and updates token across RM restart

2013-06-13 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682793#comment-13682793 ] Omkar Vinit Joshi commented on YARN-694: Addressing below issues in this patch. * NM

[jira] [Updated] (YARN-588) Two identical utility methods in different classes to build Resource

2013-06-13 Thread Niranjan Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Niranjan Singh updated YARN-588: Attachment: YARN-588.patch > Two identical utility methods in different classes to build Resource

[jira] [Updated] (YARN-773) Move YarnRuntimeException from package api.yarn to api.yarn.exceptions

2013-06-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-773: - Attachment: YARN-773.2.patch rebased on the latest trunk > Move YarnRuntimeException from package

[jira] [Commented] (YARN-799) CgroupsLCEResourcesHandler tries to write to cgroup.procs

2013-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682782#comment-13682782 ] Hadoop QA commented on YARN-799: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682778#comment-13682778 ] Sandy Ryza commented on YARN-810: - OK, I understand why my original solution isn't sufficien

[jira] [Assigned] (YARN-810) Support CGroup ceiling enforcement on CPU

2013-06-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned YARN-810: --- Assignee: Sandy Ryza > Support CGroup ceiling enforcement on CPU >

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2013-06-13 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682760#comment-13682760 ] Chris Riccomini commented on YARN-810: -- Hey Sandy, Thinking about this more, relative

[jira] [Updated] (YARN-799) CgroupsLCEResourcesHandler tries to write to cgroup.procs

2013-06-13 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/YARN-799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Riccomini updated YARN-799: - Attachment: YARN-799.0.patch Simple tweak to use /tasks instead of /cgroup.procs. Tested locally, a

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2013-06-13 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682737#comment-13682737 ] Chris Riccomini commented on YARN-810: -- For the record, I also tested that setting valu

[jira] [Commented] (YARN-799) CgroupsLCEResourcesHandler tries to write to cgroup.procs

2013-06-13 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/YARN-799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682739#comment-13682739 ] Chris Riccomini commented on YARN-799: -- Good deal. I'll send in a patch in 5m.

[jira] [Commented] (YARN-736) Add a multi-resource fair sharing metric

2013-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682740#comment-13682740 ] Hadoop QA commented on YARN-736: {color:green}+1 overall{color}. Here are the results of te

[jira] [Commented] (YARN-799) CgroupsLCEResourcesHandler tries to write to cgroup.procs

2013-06-13 Thread Adar Dembo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682734#comment-13682734 ] Adar Dembo commented on YARN-799: - Yes, I've looked at this code before. Using /tasks there

[jira] [Commented] (YARN-799) CgroupsLCEResourcesHandler tries to write to cgroup.procs

2013-06-13 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/YARN-799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682728#comment-13682728 ] Chris Riccomini commented on YARN-799: -- Hey Adar, Excellent. Looking at: http://svn.a

[jira] [Commented] (YARN-802) APPLICATION_INIT is never sent to AuxServices other than the builtin ShuffleHandler

2013-06-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682724#comment-13682724 ] Siddharth Seth commented on YARN-802: - It should be possible to configure the MR AM with

  1   2   >