[jira] [Commented] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-14 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822939#comment-13822939 ] Alejandro Abdelnur commented on YARN-1392: -- LGTM +1. when committing, please remov

[jira] [Commented] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-13 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13821950#comment-13821950 ] Alejandro Abdelnur commented on YARN-1392: -- a few final minor things: * documenta

[jira] [Commented] (YARN-1392) Allow sophisticated app-to-queue placement policies in the Fair Scheduler

2013-11-13 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13821764#comment-13821764 ] Alejandro Abdelnur commented on YARN-1392: -- Overall looks good. * Javadoc warning

[jira] [Commented] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-11-13 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13821695#comment-13821695 ] Alejandro Abdelnur commented on YARN-1241: -- patch needs to be rebased, it does not

[jira] [Commented] (YARN-1407) apps REST API filters queries by YarnApplicationState, but includes RMAppStates in response

2013-11-13 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13821692#comment-13821692 ] Alejandro Abdelnur commented on YARN-1407: -- Agree with [~tgraves], +1 after doc ad

[jira] [Commented] (YARN-1404) Add support for unmanaged containers

2013-11-13 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13821657#comment-13821657 ] Alejandro Abdelnur commented on YARN-1404: -- [~ste...@apache.org] bq. 1. I'd be in

[jira] [Commented] (YARN-1040) De-link container life cycle from the process and add ability to execute multiple processes in the same long-lived container

2013-11-13 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13821597#comment-13821597 ] Alejandro Abdelnur commented on YARN-1040: -- [~bikassaha], if I got it right, you s

[jira] [Commented] (YARN-1404) Add support for unmanaged containers

2013-11-12 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13820742#comment-13820742 ] Alejandro Abdelnur commented on YARN-1404: -- I've started working out on a patch th

[jira] [Commented] (YARN-1040) De-link container life cycle from the process and add ability to execute multiple processes in the same long-lived container

2013-11-12 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13820645#comment-13820645 ] Alejandro Abdelnur commented on YARN-1040: -- [~bikassaha], a minor twist to the out

[jira] [Commented] (YARN-1404) Add support for unmanaged containers

2013-11-12 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13820641#comment-13820641 ] Alejandro Abdelnur commented on YARN-1404: -- [~hitesh], We actually don't need the

[jira] [Commented] (YARN-1404) Add support for unmanaged containers

2013-11-12 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13820200#comment-13820200 ] Alejandro Abdelnur commented on YARN-1404: -- [~hitesh], bq. How is scheduling man

[jira] [Commented] (YARN-1404) Add support for unmanaged containers

2013-11-12 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13820132#comment-13820132 ] Alejandro Abdelnur commented on YARN-1404: -- The idea for unmanaged containers is n

[jira] [Updated] (YARN-1404) Add support for unmanaged containers

2013-11-12 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1404: - Attachment: YARN-1404.patch Initial patch showing the described approach. > Add support f

[jira] [Created] (YARN-1404) Add support for unmanaged containers

2013-11-12 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created YARN-1404: Summary: Add support for unmanaged containers Key: YARN-1404 URL: https://issues.apache.org/jira/browse/YARN-1404 Project: Hadoop YARN Issue Type: Ne

[jira] [Commented] (YARN-786) Expose application resource usage in RM REST API

2013-10-31 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13810800#comment-13810800 ] Alejandro Abdelnur commented on YARN-786: - +1 > Expose application resource usage i

[jira] [Created] (YARN-1382) NodeListManager has a memory leak, unusableRMNodesConcurrentSet is never purged

2013-10-31 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created YARN-1382: Summary: NodeListManager has a memory leak, unusableRMNodesConcurrentSet is never purged Key: YARN-1382 URL: https://issues.apache.org/jira/browse/YARN-1382 P

[jira] [Resolved] (YARN-1343) NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs

2013-10-30 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur resolved YARN-1343. -- Resolution: Fixed Hadoop Flags: Reviewed > NodeManagers additions/restarts are not

[jira] [Commented] (YARN-1343) NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs

2013-10-30 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13809821#comment-13809821 ] Alejandro Abdelnur commented on YARN-1343: -- [~bikassaha], on your ask about checki

[jira] [Updated] (YARN-1343) NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs

2013-10-30 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1343: - Attachment: YARN-1343.patch TheTestRMNodeTransition tests only verify the expected follow

[jira] [Updated] (YARN-1343) NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs

2013-10-30 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1343: - Attachment: YARN-1343.patch [~bikassaha], thanks for the review and catching the double di

[jira] [Updated] (YARN-1321) NMTokenCache is a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-30 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1321: - Attachment: YARN-1321.patch patch fixing javadoc warning. > NMTokenCache is a singleton,

[jira] [Commented] (YARN-1321) NMTokenCache is a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-29 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13808491#comment-13808491 ] Alejandro Abdelnur commented on YARN-1321: -- [~vinodkv], 2.2.1 would be great, than

[jira] [Comment Edited] (YARN-786) Expose application resource usage in RM REST API

2013-10-29 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13808329#comment-13808329 ] Alejandro Abdelnur edited comment on YARN-786 at 10/29/13 7:16 PM: ---

[jira] [Commented] (YARN-786) Expose application resource usage in RM REST API

2013-10-29 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13808329#comment-13808329 ] Alejandro Abdelnur commented on YARN-786: - +1 LGTM > Expose application resource us

[jira] [Updated] (YARN-1343) NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs

2013-10-28 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1343: - Attachment: YARN-1343.patch updated patch as per last comment. > NodeManagers additions/r

[jira] [Commented] (YARN-1343) NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs

2013-10-28 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13807191#comment-13807191 ] Alejandro Abdelnur commented on YARN-1343: -- Bikas, Vinod, Sandy and I had an offli

[jira] [Commented] (YARN-1321) NMTokenCache is a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-28 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13807186#comment-13807186 ] Alejandro Abdelnur commented on YARN-1321: -- same as before, the extra javac warnin

[jira] [Updated] (YARN-1321) NMTokenCache is a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-28 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1321: - Attachment: YARN-1321.patch Updated patch following an offline chat with Vinod, Bikas and

[jira] [Commented] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-24 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13804743#comment-13804743 ] Alejandro Abdelnur commented on YARN-1335: -- thanks for clarifying, +1 then. > Mov

[jira] [Commented] (YARN-1335) Move duplicate code from FSSchedulerApp and FiCaSchedulerApp into SchedulerApplication

2013-10-24 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13804697#comment-13804697 ] Alejandro Abdelnur commented on YARN-1335: -- * SchedulerApplication ** public Res

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-24 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13804206#comment-13804206 ] Alejandro Abdelnur commented on YARN-1321: -- [~vinodkv], kind of agree with [~sandy

[jira] [Commented] (YARN-1343) NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs

2013-10-24 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13804200#comment-13804200 ] Alejandro Abdelnur commented on YARN-1343: -- [~bikassaha], I disagree that this is

[jira] [Commented] (YARN-1343) NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs

2013-10-23 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13803568#comment-13803568 ] Alejandro Abdelnur commented on YARN-1343: -- bq. My suggestion is to pass the addit

[jira] [Commented] (YARN-1343) NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs

2013-10-23 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13803493#comment-13803493 ] Alejandro Abdelnur commented on YARN-1343: -- because if not, added/restarted nodes

[jira] [Updated] (YARN-1343) NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs

2013-10-23 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1343: - Attachment: YARN-1343.patch I've also verified in a deployment the AM does received the no

[jira] [Commented] (YARN-1343) NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs

2013-10-23 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13803337#comment-13803337 ] Alejandro Abdelnur commented on YARN-1343: -- The problem is that the RMNodeImpl.Add

[jira] [Created] (YARN-1343) NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs

2013-10-23 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created YARN-1343: Summary: NodeManagers additions/restarts are not reported as node updates in AllocateResponse responses to AMs Key: YARN-1343 URL: https://issues.apache.org/jira/browse/YA

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-22 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13802437#comment-13802437 ] Alejandro Abdelnur commented on YARN-1321: -- [~vinodkv], thanks for following up ..

[jira] [Commented] (YARN-1330) Fair Scheduler: defaultQueueSchedulingPolicy does not take effect

2013-10-22 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13802233#comment-13802233 ] Alejandro Abdelnur commented on YARN-1330: -- +1 LGTM > Fair Scheduler: defaultQueu

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801317#comment-13801317 ] Alejandro Abdelnur commented on YARN-1321: -- IMO, testing that a instance different

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13801283#comment-13801283 ] Alejandro Abdelnur commented on YARN-1321: -- same as before, the extra javac warnin

[jira] [Updated] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1321: - Attachment: YARN-1321.patch Sandy, Omkar, thanks for reviewing the patch. I've normalized

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800772#comment-13800772 ] Alejandro Abdelnur commented on YARN-1321: -- The extra javac warning is expected as

[jira] [Updated] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-21 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1321: - Attachment: YARN-1321.patch uploading proper patch, the previous one was incomplete as I d

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800343#comment-13800343 ] Alejandro Abdelnur commented on YARN-1321: -- As test-patch may not run tests in map

[jira] [Updated] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1321: - Attachment: YARN-1321.patch Preliminary patch addressing compatibility concerns. It does n

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-19 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800048#comment-13800048 ] Alejandro Abdelnur commented on YARN-1321: -- got it. have and idea on how to addres

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-19 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800028#comment-13800028 ] Alejandro Abdelnur commented on YARN-1321: -- [~hitesh], the changes would be restri

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-19 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13800014#comment-13800014 ] Alejandro Abdelnur commented on YARN-1321: -- The patch does not break existing apps

[jira] [Updated] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly

2013-10-18 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1321: - Summary: NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to w

[jira] [Updated] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly.

2013-10-18 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1321: - Attachment: YARN-1321.patch Attached a patch with the proposed solution. So far this is t

[jira] [Commented] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly.

2013-10-18 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799747#comment-13799747 ] Alejandro Abdelnur commented on YARN-1321: -- We run into this issue in Llama. Llama

[jira] [Updated] (YARN-1321) NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to work correctly.

2013-10-18 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1321: - Summary: NMTokenCache is a a singleton, prevents multiple AMs running in a single JVM to w

[jira] [Commented] (YARN-1321) NMTokenCache should not be a singleton

2013-10-18 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13799423#comment-13799423 ] Alejandro Abdelnur commented on YARN-1321: -- NMTokens are set in YARN AMRMClientImp

[jira] [Created] (YARN-1321) NMTokenCache should not be a singleton

2013-10-18 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created YARN-1321: Summary: NMTokenCache should not be a singleton Key: YARN-1321 URL: https://issues.apache.org/jira/browse/YARN-1321 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-17 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13798601#comment-13798601 ] Alejandro Abdelnur commented on YARN-1288: -- +1. Would be possible in the docs to m

[jira] [Commented] (YARN-1315) TestQueueACLs should also test FairScheduler

2013-10-16 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13797569#comment-13797569 ] Alejandro Abdelnur commented on YARN-1315: -- Sandy told me off line this passes wit

[jira] [Commented] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-16 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13797568#comment-13797568 ] Alejandro Abdelnur commented on YARN-1288: -- patch LGTM. Before committing it ...

[jira] [Commented] (YARN-1241) In Fair Scheduler maxRunningApps does not work for non-leaf queues

2013-10-16 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13797138#comment-13797138 ] Alejandro Abdelnur commented on YARN-1241: -- * FairScheduler.java ** false changes

[jira] [Commented] (YARN-1288) Make Fair Scheduler ACLs more user friendly

2013-10-16 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13797112#comment-13797112 ] Alejandro Abdelnur commented on YARN-1288: -- * Queue.java: ** false change line 46

[jira] [Commented] (YARN-1290) Let continuous scheduling achieve more balanced task assignment

2013-10-14 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13794602#comment-13794602 ] Alejandro Abdelnur commented on YARN-1290: -- [~ywskycn], approach looks good, I'd s

[jira] [Commented] (YARN-1265) Fair Scheduler chokes on unhealthy node reconnect

2013-10-10 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13792046#comment-13792046 ] Alejandro Abdelnur commented on YARN-1265: -- +1 > Fair Scheduler chokes on unhealt

[jira] [Updated] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-09 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1284: - Fix Version/s: (was: 2.3.0) 2.2.1 committed to branch-2.2. > LCE:

[jira] [Commented] (YARN-1258) Allow configuring the Fair Scheduler root queue

2013-10-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13789989#comment-13789989 ] Alejandro Abdelnur commented on YARN-1258: -- LGTM, just 1 minor thing, instead doin

[jira] [Commented] (YARN-976) Document the meaning of a virtual core

2013-10-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13789984#comment-13789984 ] Alejandro Abdelnur commented on YARN-976: - +1 > Document the meaning of a virtual c

[jira] [Updated] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1284: - Attachment: YARN-1284.patch Updating patch with one last change (which it was not in my gi

[jira] [Commented] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13789978#comment-13789978 ] Alejandro Abdelnur commented on YARN-1284: -- For the record, I've spend a couple ho

[jira] [Updated] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1284: - Attachment: YARN-1284.patch Addressing Sandy's comments. Reworked the while loop logic usi

[jira] [Commented] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13789769#comment-13789769 ] Alejandro Abdelnur commented on YARN-1284: -- tested in a cluster using cgroups and

[jira] [Updated] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1284: - Attachment: YARN-1284.patch > LCE: Race condition leaves dangling cgroups entries for kill

[jira] [Updated] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1284: - Attachment: YARN-1284.patch > LCE: Race condition leaves dangling cgroups entries for kill

[jira] [Updated] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1284: - Target Version/s: 2.2.1 > LCE: Race condition leaves dangling cgroups entries for killed c

[jira] [Updated] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1284: - Attachment: YARN-1284.patch The patch changes the deleteCgroup() method to retry the delet

[jira] [Created] (YARN-1284) LCE: Race condition leaves dangling cgroups entries for killed containers

2013-10-07 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created YARN-1284: Summary: LCE: Race condition leaves dangling cgroups entries for killed containers Key: YARN-1284 URL: https://issues.apache.org/jira/browse/YARN-1284 Project

[jira] [Commented] (YARN-1274) LCE fails to run containers that don't have resources to localize

2013-10-04 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13786942#comment-13786942 ] Alejandro Abdelnur commented on YARN-1274: -- [~sseth], now that you mention the log

[jira] [Commented] (YARN-1274) LCE fails to run containers that don't have resources to localize

2013-10-04 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13786903#comment-13786903 ] Alejandro Abdelnur commented on YARN-1274: -- [~vinodkv], I was planning to take a s

[jira] [Created] (YARN-1274) LCE fails to run containers that don't have resources to localize

2013-10-04 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created YARN-1274: Summary: LCE fails to run containers that don't have resources to localize Key: YARN-1274 URL: https://issues.apache.org/jira/browse/YARN-1274 Project: Hadoop

[jira] [Commented] (YARN-1268) TestFairScheduler.testContinuousScheduling is flaky

2013-10-04 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13786757#comment-13786757 ] Alejandro Abdelnur commented on YARN-1268: -- +1 > TestFairScheduler.testContinuous

[jira] [Commented] (YARN-867) Isolation of failures in aux services

2013-10-04 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13786402#comment-13786402 ] Alejandro Abdelnur commented on YARN-867: - [~bikassaha] got it, missed that was move

[jira] [Commented] (YARN-867) Isolation of failures in aux services

2013-10-04 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13786288#comment-13786288 ] Alejandro Abdelnur commented on YARN-867: - patch6 does not look good to me, the try/

[jira] [Commented] (YARN-1236) FairScheduler setting queue name in RMApp is not working

2013-10-03 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785638#comment-13785638 ] Alejandro Abdelnur commented on YARN-1236: -- +1 > FairScheduler setting queue name

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-10-03 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785628#comment-13785628 ] Alejandro Abdelnur commented on YARN-1197: -- Bikas, yep, there is a race condition

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-10-03 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785403#comment-13785403 ] Alejandro Abdelnur commented on YARN-1197: -- Bikas, makes sense, thanks for summari

[jira] [Commented] (YARN-867) Isolation of failures in aux services

2013-10-03 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785364#comment-13785364 ] Alejandro Abdelnur commented on YARN-867: - the try/catch should be around each aux s

[jira] [Comment Edited] (YARN-1197) Support changing resources of an allocated container

2013-10-03 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785293#comment-13785293 ] Alejandro Abdelnur edited comment on YARN-1197 at 10/3/13 3:47 PM: --

[jira] [Comment Edited] (YARN-1197) Support changing resources of an allocated container

2013-10-03 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785293#comment-13785293 ] Alejandro Abdelnur edited comment on YARN-1197 at 10/3/13 3:47 PM: --

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-10-03 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785293#comment-13785293 ] Alejandro Abdelnur commented on YARN-1197: -- [~gp.leftnoteasy], thanks for your pre

[jira] [Comment Edited] (YARN-1253) Changes to LinuxContainerExecutor to run containers as a single dedicated user in non-secure mode

2013-10-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784667#comment-13784667 ] Alejandro Abdelnur edited comment on YARN-1253 at 10/3/13 12:18 AM: -

[jira] [Commented] (YARN-1213) Add an equivalent of mapred.fairscheduler.allow.undeclared.pools to the Fair Scheduler

2013-10-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784671#comment-13784671 ] Alejandro Abdelnur commented on YARN-1213: -- +1 pending jenkins > Add an equivalen

[jira] [Commented] (YARN-1253) Changes to LinuxContainerExecutor to run containers as a single dedicated user in non-secure mode

2013-10-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784667#comment-13784667 ] Alejandro Abdelnur commented on YARN-1253: -- Create YARN-1267 to refactor and decou

[jira] [Created] (YARN-1267) Refactor cgroup logic out of LCE into a standalone binary

2013-10-02 Thread Alejandro Abdelnur (JIRA)
Alejandro Abdelnur created YARN-1267: Summary: Refactor cgroup logic out of LCE into a standalone binary Key: YARN-1267 URL: https://issues.apache.org/jira/browse/YARN-1267 Project: Hadoop YARN

[jira] [Commented] (YARN-1232) Configuration to support multiple RMs

2013-10-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13784465#comment-13784465 ] Alejandro Abdelnur commented on YARN-1232: -- IMO they are different: * the HA ids

[jira] [Commented] (YARN-1253) Changes to LinuxContainerExecutor to run containers as a single dedicated user in non-secure mode

2013-10-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783627#comment-13783627 ] Alejandro Abdelnur commented on YARN-1253: -- [~acmurthy], doing cgroups outside of

[jira] [Updated] (YARN-1253) Changes to LinuxContainerExecutor to run containers as a single dedicated user in non-secure mode

2013-10-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1253: - Target Version/s: 2.1.2-beta setting target version to 2.1.2-beta as this is enables using

[jira] [Commented] (YARN-1253) Changes to LinuxContainerExecutor to run containers as a single dedicated user in non-secure mode

2013-10-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783431#comment-13783431 ] Alejandro Abdelnur commented on YARN-1253: -- +1. I've deployed and tested in a clus

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-10-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783406#comment-13783406 ] Alejandro Abdelnur commented on YARN-1197: -- for my own education, how are you plan

[jira] [Commented] (YARN-1253) Changes to LinuxContainerExecutor to run containers as a single dedicated user in non-secure mode

2013-10-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783271#comment-13783271 ] Alejandro Abdelnur commented on YARN-1253: -- First of all, apologies for the old su

[jira] [Commented] (YARN-1228) Clean up Fair Scheduler configuration loading

2013-10-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783192#comment-13783192 ] Alejandro Abdelnur commented on YARN-1228: -- +1 LGTM. > Clean up Fair Scheduler co

[jira] [Commented] (YARN-1253) Changes to LinuxContainerExecutor to use cgroups in unsecure mode

2013-10-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13783161#comment-13783161 ] Alejandro Abdelnur commented on YARN-1253: -- If we say that today people should use

[jira] [Commented] (YARN-1253) Changes to LinuxContainerExecutor to use cgroups in unsecure mode

2013-09-30 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782435#comment-13782435 ] Alejandro Abdelnur commented on YARN-1253: -- LCE it works in a no-secure setup, but

<    1   2   3   4   5   6   7   >