[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-07 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677937#comment-13677937 ] Tom White commented on YARN-689: +1 to Hitesh and Bikas' points about minimum (and

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-06 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13676843#comment-13676843 ] Tom White commented on YARN-689: The multiplier seems to be one approach to do this, though

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-06 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677181#comment-13677181 ] Hitesh Shah commented on YARN-689: -- [~tucu00] [~bikassaha] Should we just remove min

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-06 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13677247#comment-13677247 ] Bikas Saha commented on YARN-689: - bq. the MRAppMaster obtains the MIN/MAX values from the

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-05 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13675988#comment-13675988 ] Tom White commented on YARN-689: I had a look at the latest patch. Why is

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-05 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13676019#comment-13676019 ] Alejandro Abdelnur commented on YARN-689: - [~tomwhite], thanks for looking at the

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-05 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13676096#comment-13676096 ] Tom White commented on YARN-689: the change in the yarn-default.xml from 32 to 4 is because

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-05 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13676121#comment-13676121 ] Bikas Saha commented on YARN-689: - I can see some merit in different schedulers trying out

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-05 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13676164#comment-13676164 ] Alejandro Abdelnur commented on YARN-689: - [~bikassaha], the {{MRAppMaster}} obtains

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-04 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13674293#comment-13674293 ] Arun C Murthy commented on YARN-689: bq. It seems that there's a concern about impacting

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-04 Thread Timothy St. Clair (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13675121#comment-13675121 ] Timothy St. Clair commented on YARN-689: Just to interject again, but whenever a

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-04 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13675281#comment-13675281 ] Alejandro Abdelnur commented on YARN-689: - [~acmurthy]. Can you explain why if

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-03 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673518#comment-13673518 ] Arun C Murthy commented on YARN-689: Regarding API, we can add a FS specific api. That

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-03 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673517#comment-13673517 ] Arun C Murthy commented on YARN-689: bq. What is for concern for decoupling minimum and

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-03 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673525#comment-13673525 ] Alejandro Abdelnur commented on YARN-689: - [~acmurthy], the fragmentation problem

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-03 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673532#comment-13673532 ] Arun C Murthy commented on YARN-689: bq. the fragmentation problem you describe it can

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-03 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673582#comment-13673582 ] Tom White commented on YARN-689: It seems that there's a concern about impacting CS with

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-03 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673703#comment-13673703 ] Arun C Murthy commented on YARN-689: bq. Unless I'm missing something, if today you set

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-06-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13673722#comment-13673722 ] Hadoop QA commented on YARN-689: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-30 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13671068#comment-13671068 ] Arun C Murthy commented on YARN-689: [~tucu00] Thanks for providing context - it was

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-22 Thread Timothy St. Clair (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13664616#comment-13664616 ] Timothy St. Clair commented on YARN-689: Hi folks, +1 in agreement with [~tucu00],

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-21 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13663042#comment-13663042 ] Hitesh Shah commented on YARN-689: -- [~tucu00] Regardless of whether an app is more

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13663140#comment-13663140 ] Karthik Kambatla commented on YARN-689: --- Just caught up on the conversation. Is there

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-21 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13663201#comment-13663201 ] Hitesh Shah commented on YARN-689: -- [~kkambatl] The main question is whether there is a

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-21 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13663217#comment-13663217 ] Alejandro Abdelnur commented on YARN-689: - [~hitest], in my use case, the AM is

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-21 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13663240#comment-13663240 ] Hitesh Shah commented on YARN-689: -- [~tucu00] If I understood correctly, what you seem to

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-21 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13663259#comment-13663259 ] Alejandro Abdelnur commented on YARN-689: - [~hitesh], if i do this my resource

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-21 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13663398#comment-13663398 ] Arun C Murthy commented on YARN-689: {quote} [~hitest], in my use case, the AM is

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-21 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13663399#comment-13663399 ] Arun C Murthy commented on YARN-689: Also, other than the lack of clarity on the need

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-21 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13663473#comment-13663473 ] Alejandro Abdelnur commented on YARN-689: - [~acmurthy], let me try to be a bit more

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13662069#comment-13662069 ] Alejandro Abdelnur commented on YARN-689: - [~hitesh], I have an additional use case

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13662147#comment-13662147 ] Hitesh Shah commented on YARN-689: -- [~sandyr] - good point. [~tucu00] - I am not too sure

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-20 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13662322#comment-13662322 ] Arun C Murthy commented on YARN-689: bq. All the nodes in a cluster have 3 GB. Because

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13662448#comment-13662448 ] Alejandro Abdelnur commented on YARN-689: - [~acmurthy], would you please explain how

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-20 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13662576#comment-13662576 ] Arun C Murthy commented on YARN-689: [~tucu00] Which one? Add

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-20 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13662630#comment-13662630 ] Alejandro Abdelnur commented on YARN-689: - Here it goes again: I have an additional

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-17 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660779#comment-13660779 ] Alejandro Abdelnur commented on YARN-689: - The headroom needed to run a container,

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-17 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660840#comment-13660840 ] Hitesh Shah commented on YARN-689: -- The assumption you seem to be making is that all

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-17 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660874#comment-13660874 ] Alejandro Abdelnur commented on YARN-689: - There is a headroom that YARN requires,

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-17 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660919#comment-13660919 ] Hitesh Shah commented on YARN-689: -- I am not sure I understand the headroom references that

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-17 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660943#comment-13660943 ] Alejandro Abdelnur commented on YARN-689: - Got the point of a container not having a

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-17 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13661010#comment-13661010 ] Hitesh Shah commented on YARN-689: -- +1 to renaming the current minimum to indicate slot

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-17 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13661159#comment-13661159 ] Sandy Ryza commented on YARN-689: - Consider this situation: All the nodes in a cluster have

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-17 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13661235#comment-13661235 ] Alejandro Abdelnur commented on YARN-689: - Sandy, thanks for coming up with an

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13661236#comment-13661236 ] Hadoop QA commented on YARN-689: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13661278#comment-13661278 ] Hadoop QA commented on YARN-689: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660332#comment-13660332 ] Hadoop QA commented on YARN-689: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660337#comment-13660337 ] Hadoop QA commented on YARN-689: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-689) Add multiplier unit to resourcecapabilities

2013-05-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13660359#comment-13660359 ] Vinod Kumar Vavilapalli commented on YARN-689: -- Are there cases where