[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503776#comment-15503776
]
Sunil G commented on YARN-4945:
---
As we are going more detailed reviews, I think we can do it in YARN-2009
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15502794#comment-15502794
]
Sunil G commented on YARN-4945:
---
My bad too.. I also only ran UT cases after this change. Thank you very
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15499359#comment-15499359
]
Eric Payne commented on YARN-4945:
--
[~sunilg], I'm afraid I gave you bad advice [in my comment
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497081#comment-15497081
]
Sunil G commented on YARN-4945:
---
Thanks [~eepayne],
I think the scenario makes sense to me. And as earlier
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497037#comment-15497037
]
Eric Payne commented on YARN-4945:
--
[~leftnoteasy]
bq. Have a Map of username to headroom inside the
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15495060#comment-15495060
]
Eric Payne commented on YARN-4945:
--
[~sunilg],
I noticed in the resourcemanager log that the metrics were
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15494825#comment-15494825
]
Wangda Tan commented on YARN-4945:
--
1) YarnConfiguration:
- Instead of have a separate
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15494454#comment-15494454
]
Wangda Tan commented on YARN-4945:
--
[~eepayne],
bq. I need to understand what it would mean to combine
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15494394#comment-15494394
]
Eric Payne commented on YARN-4945:
--
bq. I would say it may not be necessarily to have two separate
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15494187#comment-15494187
]
Wangda Tan commented on YARN-4945:
--
[~eepayne] / [~sunilg],
For the suggestion from [~eepayne]:
bq. I
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15494103#comment-15494103
]
Sunil G commented on YARN-4945:
---
I think i missed the previous comment from [~eepayne]. Let me share another
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15493893#comment-15493893
]
Eric Payne commented on YARN-4945:
--
Thanks again, [~sunilg]. I will look closely at the patch, but one
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15492609#comment-15492609
]
Wangda Tan commented on YARN-4945:
--
[~sunilg], took a quick look at the patch, overall approach looks
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488403#comment-15488403
]
Eric Payne commented on YARN-4945:
--
bq. Does this make sense?
[~sunilg], Thanks for the reply. Yes. I was
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478614#comment-15478614
]
Sunil G commented on YARN-4945:
---
Thanks [~eepayne] for the detailed comments.
Agreeing to the comments
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478599#comment-15478599
]
Sunil G commented on YARN-4945:
---
Thanks [~leftnoteasy] for the offline discussion. Updating the summary here.
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478391#comment-15478391
]
Eric Payne commented on YARN-4945:
--
Thanks [~sunilg]. I have a few review comments for patch v0:
-
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477484#comment-15477484
]
Sunil G commented on YARN-4945:
---
HI [~leftnoteasy]
Thanks for comments..
I generally understood the overall
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15475092#comment-15475092
]
Wangda Tan commented on YARN-4945:
--
Thanks [~sunilg],
Comments for v0:
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472262#comment-15472262
]
Wangda Tan commented on YARN-4945:
--
[~eepayne],
bq. I actually would like to have the priority policy and
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472235#comment-15472235
]
Eric Payne commented on YARN-4945:
--
[~sunilg], thanks again for all of the great work you are doing on
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472191#comment-15472191
]
Eric Payne commented on YARN-4945:
--
Thank you [~leftnoteasy]. I see now that
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471794#comment-15471794
]
Wangda Tan commented on YARN-4945:
--
Hi [~eepayne],
Maybe there're some misunderstandings, first of all,
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471536#comment-15471536
]
Eric Payne commented on YARN-4945:
--
[~leftnoteasy] and [~sunilg], I'm still concerned about having the
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468165#comment-15468165
]
Eric Payne commented on YARN-4945:
--
Thanks [~sunilg].
{quote}
bq. if it's already in selectedCandidates,
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466489#comment-15466489
]
Sunil G commented on YARN-4945:
---
Thanks [~eepayne]
bq.LeafQueue#getApplications returns an umnodifiable
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465592#comment-15465592
]
Eric Payne commented on YARN-4945:
--
[~leftnoteasy] and [~sunilg],
bq. Using logic similar to
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458695#comment-15458695
]
Eric Payne commented on YARN-4945:
--
[~sunilg], just one quick note: I am getting a
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456727#comment-15456727
]
Wangda Tan commented on YARN-4945:
--
bq. Trying to do this coordination seems to me to be quite
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456717#comment-15456717
]
Wangda Tan commented on YARN-4945:
--
bq. I think we do need several intra-queue configs that are separate
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15455570#comment-15455570
]
Eric Payne commented on YARN-4945:
--
Thanks very much [~sunilg] and [~leftnoteasy].
{quote}
1.
I think we
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15454965#comment-15454965
]
Sunil G commented on YARN-4945:
---
Thanks [~leftnoteasy]
bq.What is intraQueuePreemptionCost? And what is
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15453773#comment-15453773
]
Wangda Tan commented on YARN-4945:
--
Hi Sunil,
Thanks for update, I haven't dig into too many details of
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15440197#comment-15440197
]
Wangda Tan commented on YARN-4945:
--
Thanks for discussion, [~eepayne]. [~sunilg].
I think normalization
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439387#comment-15439387
]
Sunil G commented on YARN-4945:
---
Thanks [~eepayne] for the comments about the interaction b/w inter-queue and
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439264#comment-15439264
]
Sunil G commented on YARN-4945:
---
Thanks [~eepayne] for the use cases.
Overall I feel the use cases looks
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15439148#comment-15439148
]
Eric Payne commented on YARN-4945:
--
[~sunilg] and [~leftnoteasy], While I was writing the use cases, I
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438052#comment-15438052
]
Wangda Tan commented on YARN-4945:
--
Thanks [~eepayne] for providing the detail use case requirements.
I
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432961#comment-15432961
]
Sunil G commented on YARN-4945:
---
Thank you [~eepayne] for the detailed explanation.
bq.I want to make sure we
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431513#comment-15431513
]
Eric Payne commented on YARN-4945:
--
[~sunilg], Thanks a lot for your reply!
{quote}
- user-limit: may be
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15429644#comment-15429644
]
Sunil G commented on YARN-4945:
---
bq.My assertion is that regardless of what containers are already in the
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428904#comment-15428904
]
Eric Payne commented on YARN-4945:
--
[~sunilg], thank you so much for providing this design doc and POC. I
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15395858#comment-15395858
]
Sunil G commented on YARN-4945:
---
Extremely sorry for the delay.
bq. With the proposed design, is it possible
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392303#comment-15392303
]
Eric Payne commented on YARN-4945:
--
{quote}
This is considering priority of apps alone. Yes, we have to
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392286#comment-15392286
]
Sunil G commented on YARN-4945:
---
Thanks [~eepayne]
bq.I would like to separate out the sub-feature pieces of
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392184#comment-15392184
]
Eric Payne commented on YARN-4945:
--
Thanks [~sunilg]. I appreciate very much any design help and POC help
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391671#comment-15391671
]
Sunil G commented on YARN-4945:
---
Thanks [~eepayne] and [~leftnoteasy]
Yes, I was working on a POC patch for
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15389859#comment-15389859
]
Wangda Tan commented on YARN-4945:
--
[~eepayne], I totally agree that intra-queue preemption should happen
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15389828#comment-15389828
]
Eric Payne commented on YARN-4945:
--
HI [~leftnoteasy]. Sorry for the long delay. I am now starting to have
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241922#comment-15241922
]
Wangda Tan commented on YARN-4945:
--
[~eepayne],
Above is one of the case that needs intra-queue
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241683#comment-15241683
]
Eric Payne commented on YARN-4945:
--
Thanks [~leftnoteasy]. I have seen the following use case where
[
https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236305#comment-15236305
]
Wangda Tan commented on YARN-4945:
--
Some rough ideas about design:
In general, after YARN-4822, we can
52 matches
Mail list logo
