[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612854#comment-15612854 ] Wangda Tan commented on YARN-2009: -- Thanks [~curino], and [~eepayne], could you also share your thoughts

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612769#comment-15612769 ] Carlo Curino commented on YARN-2009: I am starting reviewing this as part of the YARN-meetup bug bash.

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612098#comment-15612098 ] Sunil G commented on YARN-2009: --- Thanks [~eepayne]. Yes. I am working on scheduler's user-limit improvement

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-27 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611992#comment-15611992 ] Eric Payne commented on YARN-2009: -- {quote} My suggestion is: commit existing patch, at least it works for

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15611189#comment-15611189 ] Sunil G commented on YARN-2009: --- Hi [~eepayne] and [~leftnoteasy] I am also inline with Wangda's thought. I

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610444#comment-15610444 ] Wangda Tan commented on YARN-2009: -- Hi [~eepayne], Really appreciate your help on testing and give

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-26 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609848#comment-15609848 ] Eric Payne commented on YARN-2009: -- bq. there are cases where unnecessary preemption still happens. I have

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609623#comment-15609623 ] Wangda Tan commented on YARN-2009: -- I suggest to commit this patch first and fix other possible problems

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609597#comment-15609597 ] Wangda Tan commented on YARN-2009: -- [~eepayne], [~sunilg]. I'm not sure if we need to consider free

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609409#comment-15609409 ] Sunil G commented on YARN-2009: --- I understand the reason for this issue. Queue's free resource were not

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609101#comment-15609101 ] Sunil G commented on YARN-2009: --- Thanks [~eepayne] for the update. I will also investigate with few more

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-26 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609030#comment-15609030 ] Eric Payne commented on YARN-2009: -- [~sunilg], I am still analyzing the code, but I do want to point out

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15605241#comment-15605241 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603244#comment-15603244 ] Wangda Tan commented on YARN-2009: -- Thanks for update [~sunilg], I have one doubt: should we deduct sum

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601105#comment-15601105 ] Sunil G commented on YARN-2009: --- Test case failures are not related. YARN-5362 is handling the same. >

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596365#comment-15596365 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595958#comment-15595958 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15595206#comment-15595206 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15594997#comment-15594997 ] Sunil G commented on YARN-2009: --- [~eepayne], I have added a unit test case which was not added here. I ll

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15594971#comment-15594971 ] Eric Payne commented on YARN-2009: -- bq. the test code which i posted was from my unit test Thanks

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-20 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593887#comment-15593887 ] Sunil G commented on YARN-2009: --- Thanks [~eepayne] for sharing detailed test scenario. I tested manually

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-20 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593001#comment-15593001 ] Eric Payne commented on YARN-2009: -- Hi [~sunilg]. I am confused by something you said in the [comment

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-20 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592740#comment-15592740 ] Eric Payne commented on YARN-2009: -- Hi [~sunilg]. Here is a description of my test environment, the steps

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-20 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591597#comment-15591597 ] Sunil G commented on YARN-2009: --- I tested below case {noformat} String queuesConfig = //

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-20 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591027#comment-15591027 ] Sunil G commented on YARN-2009: --- Hi [~eepayne] Could you please let me know the user-limit which is used for

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589980#comment-15589980 ] Eric Payne commented on YARN-2009: -- [~sunilg], thanks for the updated patch. There is a problem with

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589781#comment-15589781 ] Wangda Tan commented on YARN-2009: -- Latest patch looks good, thanks [~sunilg]! Any other comments for the

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589759#comment-15589759 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589239#comment-15589239 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15586152#comment-15586152 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-17 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583579#comment-15583579 ] Eric Payne commented on YARN-2009: -- Thanks for the updated patch [~sunilg]. Should this feature work with

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583422#comment-15583422 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583383#comment-15583383 ] Wangda Tan commented on YARN-2009: -- Thanks for updating the patch, [~sunilg] and thanks thorough review

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15577129#comment-15577129 ] Sunil G commented on YARN-2009: --- Thanks [~eepayne] I also ran into a similar point yesterday and found root

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576735#comment-15576735 ] Eric Payne commented on YARN-2009: -- Hi [~sunilg]. I think I would suggest to do the following:

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576235#comment-15576235 ] Eric Payne commented on YARN-2009: -- [~sunilg], I have one concern about how

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574188#comment-15574188 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573093#comment-15573093 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572984#comment-15572984 ] Eric Payne commented on YARN-2009: -- [~sunilg], I think you may have missed my comment from

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572955#comment-15572955 ] Eric Payne commented on YARN-2009: -- Thanks [~sunilg]. In order to backport YARN-2009 to 2.8, I think that

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572765#comment-15572765 ] Eric Payne commented on YARN-2009: -- [~sunilg], do you plan on backporting this to branch-2/branch-2.8? >

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15564420#comment-15564420 ] Sunil G commented on YARN-2009: --- Thanks [~eepayne] I am already working on user-limit and will share the

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15562302#comment-15562302 ] Eric Payne commented on YARN-2009: -- Thanks for all the work [~sunilg] and [~leftnoteasy] have put into

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1895#comment-1895 ] Wangda Tan commented on YARN-2009: -- bq. I am not comfortable with fixing this in another patch. Our main

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553303#comment-15553303 ] Eric Payne commented on YARN-2009: -- Thanks, [~sunilg], for your reply. - -

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552696#comment-15552696 ] Sunil G commented on YARN-2009: --- HI [~eepayne] Thanks for sharing the details of the usecase .I have checked

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551279#comment-15551279 ] Hadoop QA commented on YARN-2009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15550216#comment-15550216 ] Eric Payne commented on YARN-2009: -- Thanks, [~sunilg], for the new patch. Preemption for the purposes of

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543874#comment-15543874 ] Wangda Tan commented on YARN-2009: -- [~sunilg], bq. orderedApps is a list of TempAppPerPartition and

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-10-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543523#comment-15543523 ] Eric Payne commented on YARN-2009: -- Hi [~sunilg], I noticed some odd behavior while trying the following

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525174#comment-15525174 ] Wangda Tan commented on YARN-2009: -- Thanks [~sunilg], More comments: 1) Config: General, it's better

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522161#comment-15522161 ] Sunil G commented on YARN-2009: --- Thanks [~eepayne] for the detailed explanation. bq.when it comes time for

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15520009#comment-15520009 ] Eric Payne commented on YARN-2009: -- Hi [~sunilg]. After thinking more about it, I think I would like to

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15516923#comment-15516923 ] Eric Payne commented on YARN-2009: -- {quote} I also thought about this in similar lines. But there was one

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15516756#comment-15516756 ] Sunil G commented on YARN-2009: --- Thank you very much [~eepayne] for sharing the thoughts. bq.The purpose of

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514480#comment-15514480 ] Eric Payne commented on YARN-2009: -- [~leftnoteasy], Thanks. I missed that. > Priority support for

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514405#comment-15514405 ] Wangda Tan commented on YARN-2009: -- Hi [~eepayne], bq. If Queue1 has 100 resources, and if user1 starts

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514393#comment-15514393 ] Eric Payne commented on YARN-2009: -- bq. So we could take a max(guaranteed, used). Will this be fine? I

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513840#comment-15513840 ] Sunil G commented on YARN-2009: --- Hi [~eepayne] Couple of doubts on the comments. bq.Shouldn't the following

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513725#comment-15513725 ] Eric Payne commented on YARN-2009: -- [~leftnoteasy], I have some concerns about this algorithm from above:

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15513545#comment-15513545 ] Sunil G commented on YARN-2009: --- Thanks [~eepayne] for the comments. Mostly makes sense, I will update a new

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511394#comment-15511394 ] Eric Payne commented on YARN-2009: -- -

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507846#comment-15507846 ] Wangda Tan commented on YARN-2009: -- bq. I see. I wasn't suggesting that preemption should balance all

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-20 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507832#comment-15507832 ] Eric Payne commented on YARN-2009: -- {quote} In my above example, the #active_users is 2 instead of 3

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507356#comment-15507356 ] Wangda Tan commented on YARN-2009: -- [~eepayne], Existing user-limit is computed by following logic:

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-20 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507326#comment-15507326 ] Eric Payne commented on YARN-2009: -- [~leftnoteasy], I am confused by your above example: {quote} Queue's

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504991#comment-15504991 ] Wangda Tan commented on YARN-2009: -- And one additional note about why balancing user-usage only in

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504978#comment-15504978 ] Wangda Tan commented on YARN-2009: -- [~eepayne], bq. ... then I don't think idealAssigned can be

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504876#comment-15504876 ] Eric Payne commented on YARN-2009: -- [~sunilg] / [~leftnoteasy] I am still in the middle of reviewing the

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504084#comment-15504084 ] Sunil G commented on YARN-2009: --- Yes. I could avoid using that api. Will update a new patch shortly. >

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504044#comment-15504044 ] Wangda Tan commented on YARN-2009: -- [~eepayne], Oh it was a method that nobody uses. [~sunilg], could

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15504007#comment-15504007 ] Eric Payne commented on YARN-2009: -- [~sunilg], please note that your patch depends on

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503981#comment-15503981 ] Sunil G commented on YARN-2009: --- Ah. I think my branch needs a rebase. Lemme get into that. > Priority

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503934#comment-15503934 ] Eric Payne commented on YARN-2009: -- [~sunilg], Thanks for providing YARN-2009.0001.patch. Unfortunately,

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-01-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15098085#comment-15098085 ] Sunil G commented on YARN-2009: --- Thanks [~leftnoteasy] for sharing the updates. I will also take a look on

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-01-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15097704#comment-15097704 ] Wangda Tan commented on YARN-2009: -- Hi [~sunilg]/[~eepayne]. I was thinking YARN-4108 could resolve it.

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-01-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15096538#comment-15096538 ] Eric Payne commented on YARN-2009: -- {quote} Sunil G, pardon the long delay... From what you say it seems

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-01-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15096540#comment-15096540 ] Eric Payne commented on YARN-2009: -- bq. And, of course, all of this will probably have to be re-evaluated

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-01-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15096554#comment-15096554 ] Sunil G commented on YARN-2009: --- Thanks [~eepayne] for sharing the thoughts. bq.I feel that we should

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-01-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15096620#comment-15096620 ] Eric Payne commented on YARN-2009: -- Thanks [~sunilg]. One more note is that YARN-2113 was also raised to

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2014-12-11 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14243608#comment-14243608 ] Carlo Curino commented on YARN-2009: [~sunilg], pardon the long delay... From what you

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2014-11-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14223490#comment-14223490 ] Eric Payne commented on YARN-2009: -- If we are to choose the less complicated route, I

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2014-11-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14223860#comment-14223860 ] Sunil G commented on YARN-2009: --- Thank you [~curino] for the thoughts. I understand the

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2014-11-13 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14211358#comment-14211358 ] Carlo Curino commented on YARN-2009: I agree with your observation... the set of

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2014-11-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208207#comment-14208207 ] Sunil G commented on YARN-2009: --- I agree with your thoughts [~curino]. Locality constraints

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2014-11-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14205419#comment-14205419 ] Eric Payne commented on YARN-2009: -- Hi [~sunilg]. If I understand correctly, this Jira is

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2014-05-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986679#comment-13986679 ] Sunil G commented on YARN-2009: --- As per YARN-1963, jobs can be submitted in a queue with

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2014-04-30 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986128#comment-13986128 ] Carlo Curino commented on YARN-2009: If I am not mistaken this is what is happening...