[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959746#comment-15959746 ] Wangda Tan commented on YARN-6344: -- Latest patch LGTM, thanks [~kkaranasos]. > Rethinking OFF_SWITCH

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-06 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959440#comment-15959440 ] Konstantinos Karanasos commented on YARN-6344: -- Thank you all for the feedback. If nobody

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-05 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15958056#comment-15958056 ] Konstantinos Karanasos commented on YARN-6344: -- Thanks for the feedback, [~jlowe]. Indeed

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957849#comment-15957849 ] Jason Lowe commented on YARN-6344: -- I'd prefer a configured rack locality delay of zero means no

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-05 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957652#comment-15957652 ] Konstantinos Karanasos commented on YARN-6344: -- Thanks for checking the patch, [~leftnoteasy].

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957412#comment-15957412 ] Wangda Tan commented on YARN-6344: -- Thanks [~kkaranasos], {code} 281 private int

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-04 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955955#comment-15955955 ] Konstantinos Karanasos commented on YARN-6344: -- Of course, I'll wait for your feedback,

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955890#comment-15955890 ] Wangda Tan commented on YARN-6344: -- [~kkaranasos], thanks for update the patch, could you give me 1 more

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-04 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955874#comment-15955874 ] Konstantinos Karanasos commented on YARN-6344: -- There is a failing test that seems to be

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954403#comment-15954403 ] Hadoop QA commented on YARN-6344: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-03 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954321#comment-15954321 ] Konstantinos Karanasos commented on YARN-6344: -- Thanks for checking the patch, [~asuresh]! You

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-04-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952813#comment-15952813 ] Arun Suresh commented on YARN-6344: --- [~kkaranasos], the patch LGTM. I like the idea of adding the rack

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951861#comment-15951861 ] Hadoop QA commented on YARN-6344: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951663#comment-15951663 ] Hadoop QA commented on YARN-6344: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-31 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951528#comment-15951528 ] Konstantinos Karanasos commented on YARN-6344: -- I just uploaded a new version in which I

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15940808#comment-15940808 ] Sunil G commented on YARN-6344: --- Thanks [~leftnoteasy] [~kkaranasos] Makes sense for me. In future it ll be

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-23 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938973#comment-15938973 ] Konstantinos Karanasos commented on YARN-6344: -- Thank you for the input, [~sunilg] and

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938932#comment-15938932 ] Wangda Tan commented on YARN-6344: -- +1 for the proposal, and thanks [~kkaranasos] for sharing detailed

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938855#comment-15938855 ] Sunil G commented on YARN-6344: --- Thanks [~kkaranasos]. Its a much needed effort to fast up or correct the

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-22 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937580#comment-15937580 ] Konstantinos Karanasos commented on YARN-6344: -- As I mentioned, in the patch I uploaded, if

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937579#comment-15937579 ] Hadoop QA commented on YARN-6344: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-20 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15932783#comment-15932783 ] Nathan Roberts commented on YARN-6344: -- +1 on improving localityWaitFactor. It definitely won't behave

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-15 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927509#comment-15927509 ] Carlo Curino commented on YARN-6344: I agree with what [~kkaranasos] said. In our clusters, the

[jira] [Commented] (YARN-6344) Rethinking OFF_SWITCH locality in CapacityScheduler

2017-03-15 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926830#comment-15926830 ] Konstantinos Karanasos commented on YARN-6344: -- The described issue was observed together with