[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-17 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660904#comment-13660904 ] Bikas Saha commented on YARN-392: - This is confusing me. The purpose of this jira is to add

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-17 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660946#comment-13660946 ] Sandy Ryza commented on YARN-392: - We are implementing the approach outlined by Arun in his

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660345#comment-13660345 ] Sandy Ryza commented on YARN-392: - It would mean Don't give me a container at this priority

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-14 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13657504#comment-13657504 ] Sandy Ryza commented on YARN-392: - Updated patch adds javadocs Make it

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-10 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13654605#comment-13654605 ] Alejandro Abdelnur commented on YARN-392: - Agree with Sandy, the low level API

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-10 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13654655#comment-13654655 ] Bikas Saha commented on YARN-392: - Of course, changing the AMRMClient to support this would

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13654708#comment-13654708 ] Sandy Ryza commented on YARN-392: - I think the server should check weird requests and state.

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-10 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13654806#comment-13654806 ] Bikas Saha commented on YARN-392: - bq. My point was mainly that we haven't been doing these

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13655019#comment-13655019 ] Hadoop QA commented on YARN-392: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-10 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13655039#comment-13655039 ] Alejandro Abdelnur commented on YARN-392: - Sandy, patch looks good to me, only NIT

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13653133#comment-13653133 ] Hadoop QA commented on YARN-392: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13653143#comment-13653143 ] Bikas Saha commented on YARN-392: - I am fine with a boolean because the client can wait for

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-09 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13653157#comment-13653157 ] Arun C Murthy commented on YARN-392: Can we please call it 'fallThrough' or some such?

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13653195#comment-13653195 ] Sandy Ryza commented on YARN-392: - Disable-node allows you to say I specifically don't want

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-09 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13653347#comment-13653347 ] Alejandro Abdelnur commented on YARN-392: - 'fallThrough' please (even if i cannot

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-09 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13653374#comment-13653374 ] Bikas Saha commented on YARN-392: - Actually I dont quite get fallThrough :). Fall through

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13653390#comment-13653390 ] Sandy Ryza commented on YARN-392: - bq. Looks like this will be blocked by YARN-394. The APIs

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-09 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13653438#comment-13653438 ] Sandy Ryza commented on YARN-392: - bq. The AMRMClient APIs should be added to ensure that

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-05-08 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13652557#comment-13652557 ] Alejandro Abdelnur commented on YARN-392: - [~bikassaha], are you OK going with a

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-23 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13639491#comment-13639491 ] Alejandro Abdelnur commented on YARN-392: - The idea of a locality delay gives more

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-18 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13635643#comment-13635643 ] Sandy Ryza commented on YARN-392: - Uploaded a patch that adds a test for strict locality in

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13635655#comment-13635655 ] Hadoop QA commented on YARN-392: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13635684#comment-13635684 ] Hadoop QA commented on YARN-392: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13636077#comment-13636077 ] Bikas Saha commented on YARN-392: - bq. would it not make sense to go with the convention

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13630440#comment-13630440 ] Sandy Ryza commented on YARN-392: - Any further thoughts on this? Make it

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-04 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13622558#comment-13622558 ] Arun C Murthy commented on YARN-392: [~bikassaha] I'm against using timers for

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-04 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13622561#comment-13622561 ] Arun C Murthy commented on YARN-392: To be clear, the approach I took on YARN-398 allows

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-04 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13622563#comment-13622563 ] Arun C Murthy commented on YARN-392: Also, it allows for I want 'one container on any

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-04 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13622584#comment-13622584 ] Bikas Saha commented on YARN-392: - bq. I'm against using timers for specifying locality

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-04 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13622765#comment-13622765 ] Sandy Ryza commented on YARN-392: - [~acmurthy], that makes sense to me. We can use this one

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-03 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620705#comment-13620705 ] Sandy Ryza commented on YARN-392: - Ok, I will work on a patch for the non-blacklist

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-02 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619578#comment-13619578 ] Bikas Saha commented on YARN-392: - Sorry, I did not see that patch carefully and assumed

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-02 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619778#comment-13619778 ] Thomas Graves commented on YARN-392: Bikas when you say creating an API for blacklisting

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-02 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13620008#comment-13620008 ] Bikas Saha commented on YARN-392: - Yes YARN-398 but not the proposal currently in there. The

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-04-01 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13619136#comment-13619136 ] Sandy Ryza commented on YARN-392: - It seems like we have two slightly different proposals,

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-03-31 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13618475#comment-13618475 ] Bikas Saha commented on YARN-392: - How about calling is disableLocalityRelaxation as thats

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-03-28 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13616917#comment-13616917 ] Sandy Ryza commented on YARN-392: - Uploading a patch based on the earlier discussion here

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-02-25 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13585744#comment-13585744 ] Sandy Ryza commented on YARN-392: - Filed YARN-424 for Alejandro's hints proposal.

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-02-25 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13586529#comment-13586529 ] Arun C Murthy commented on YARN-392: Gang-scheduling, deadline-scheduling etc. are not

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-02-25 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13586544#comment-13586544 ] Arun C Murthy commented on YARN-392: Also, we don't have to support *all* features in

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-02-25 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13586579#comment-13586579 ] Arun C Murthy commented on YARN-392: Take a look at YARN-398 for a simpler alternate

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-02-24 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13585677#comment-13585677 ] Bikas Saha commented on YARN-392: - @Sandy It would be per priority like I mentioned in my

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-02-22 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13584703#comment-13584703 ] Alejandro Abdelnur commented on YARN-392: - I'd like to restate he problem. Making

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-02-21 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13583713#comment-13583713 ] Bikas Saha commented on YARN-392: - From what I understand this seems to be tangentially

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-02-21 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13583792#comment-13583792 ] Sandy Ryza commented on YARN-392: - The proposal of per-app delay-scheduling parameters is

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-02-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13579675#comment-13579675 ] Sandy Ryza commented on YARN-392: - I've thought about this further a little. The

[jira] [Commented] (YARN-392) Make it possible to schedule to specific nodes without dropping locality

2013-02-11 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13576299#comment-13576299 ] Bikas Saha commented on YARN-392: - Since you have already gone ahead and assigned it to