[
https://issues.apache.org/jira/browse/YARN-7903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16357515#comment-16357515
]
Yufei Gu commented on YARN-7903:
--------------------------------
{quote}
I think that we should try to make progress on that JIRA as well as this one.
{quote}
Agreed.
The request request in description is actually one RR instead of 3 RRs. If the
RR is strict about locality(RelaxLocality is false), I don't think there is
need to consider other RRs. However, that's another story if RR's RelaxLocality
is true. To enable some kind of delay scheduling for preemption seems a
reasonable solution for both YARN-6956 and this Jira.
I am still confusing about how to parse the multiple RRs of an apps, e.g. the
example in the description is actually one RRs instead of 3 RRs, what if there
size and container# are different between nodeRequest and rackRequest? Do we
consider them one RRs or multiple RRs. Without good understanding of this, I
don't think we can make any progress on YARN-6956. Please let me know your
thoughts about this. I'll try to dig more about this as well. Thanks. [~Steven
Rand].
> Method getStarvedResourceRequests() only consider the first encountered
> resource
> --------------------------------------------------------------------------------
>
> Key: YARN-7903
> URL: https://issues.apache.org/jira/browse/YARN-7903
> Project: Hadoop YARN
> Issue Type: Bug
> Components: fairscheduler
> Affects Versions: 3.1.0
> Reporter: Yufei Gu
> Priority: Major
>
> We need to specify rack and ANY while submitting a node local resource
> request, as YARN-7561 discussed. For example:
> {code}
> ResourceRequest nodeRequest =
> createResourceRequest(GB, node1.getHostName(), 1, 1, false);
> ResourceRequest rackRequest =
> createResourceRequest(GB, node1.getRackName(), 1, 1, false);
> ResourceRequest anyRequest =
> createResourceRequest(GB, ResourceRequest.ANY, 1, 1, false);
> List<ResourceRequest> resourceRequests =
> Arrays.asList(nodeRequest, rackRequest, anyRequest);
> {code}
> However, method getStarvedResourceRequests() only consider the first
> encountered resource, which most likely is ResourceRequest.ANY. That's a
> mismatch for locality request.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
