[jira] [Commented] (YARN-7655) Avoid AM preemption caused by RRs for specific nodes or racks

2018-02-08 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357942#comment-16357942 ] Yufei Gu commented on YARN-7655: aha, I found the same thing about getRelaxLocality, and just want to do

[jira] [Commented] (YARN-7655) Avoid AM preemption caused by RRs for specific nodes or racks

2018-02-08 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357913#comment-16357913 ] Steven Rand commented on YARN-7655: --- Thanks [~yufeigu]. I filed YARN-7910 for the {{TODO}} in the unit

[jira] [Commented] (YARN-7655) Avoid AM preemption caused by RRs for specific nodes or racks

2018-02-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357553#comment-16357553 ] Hudson commented on YARN-7655: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13636 (See

[jira] [Commented] (YARN-7655) Avoid AM preemption caused by RRs for specific nodes or racks

2018-02-08 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16357528#comment-16357528 ] Yufei Gu commented on YARN-7655: +1 for the last patch and committed to trunk. Thanks for the patch,

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356409#comment-16356409 ] genericqa commented on YARN-7655: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-07 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356308#comment-16356308 ] Steven Rand commented on YARN-7655: --- Sounds good, I revised the patch to mention YARN-7903 in a comment

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-07 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355905#comment-16355905 ] Yufei Gu commented on YARN-7655: File YARN-7903 for that issue. > avoid AM preemption caused by RRs for

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-07 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16355890#comment-16355890 ] Yufei Gu commented on YARN-7655: Yeah, the logic to construct a resource request list is really confusing

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353364#comment-16353364 ] genericqa commented on YARN-7655: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-05 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353279#comment-16353279 ] Steven Rand commented on YARN-7655: --- The concern I have with all three RRs being the same size is that we

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352866#comment-16352866 ] Yufei Gu commented on YARN-7655: Hi [~Steven Rand], I made it work by using following resource requests:

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-04 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351744#comment-16351744 ] genericqa commented on YARN-7655: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-04 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351704#comment-16351704 ] Steven Rand commented on YARN-7655: --- Thanks [~yufeigu], new patch is attached. Unfortunately I'm still

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351184#comment-16351184 ] genericqa commented on YARN-7655: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-02 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350831#comment-16350831 ] Yufei Gu commented on YARN-7655: The patch looks good to me generally. Only some nits: # Add Java doc to

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-01-29 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344335#comment-16344335 ] Steven Rand commented on YARN-7655: --- Sounds good, thanks! > avoid AM preemption caused by RRs for

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-01-29 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343803#comment-16343803 ] Yufei Gu commented on YARN-7655: Yes, let's move forward with this patch. We are trying to introduce node

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-01-26 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16341964#comment-16341964 ] Steven Rand commented on YARN-7655: --- I'm not sure whether many AMs wind up on a limited number of NMs.

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-01-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328166#comment-16328166 ] Yufei Gu commented on YARN-7655: Do several AMs end up running on a limited number of NM? If the answer is

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-01-14 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325928#comment-16325928 ] Steven Rand commented on YARN-7655: --- Thanks [~yufeigu] for taking a look. The cluster sizes and nodes

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-01-11 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323164#comment-16323164 ] Yufei Gu commented on YARN-7655: Thanks [~Steven Rand] for filing this. It makes sense to me to lose some

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-01-03 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310553#comment-16310553 ] Steven Rand commented on YARN-7655: --- Tagging [~yufeigu] and [~templedf] for thoughts. I can work through

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2017-12-13 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16290073#comment-16290073 ] Steven Rand commented on YARN-7655: --- One issue I'm having with the test in the patch is that preemption