[
https://issues.apache.org/jira/browse/YARN-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16379532#comment-16379532
]
Weiwei Yang commented on YARN-7929:
-----------------------------------
Hi [~asuresh]
Thanks for bringing YARN-6826 to our attention, this patch is only adding the
ability to execute O containers for SLS, mostly for testing scheduling phase.
YARN-6826 is doing more to simulate allocating/launching/preemption scenarios
which is a big step forward. I took a look at both patches, and if this one is
committed first, I don't think you will have a big problem to rebase (probably
just remove the changes to setup execution type in your patch?)
Regarding the patch in YARN-6826, it looks to me like the O containers are
still launched based on the allocated resource instead of the actual
utilization right? You may notice that in this patch, it introduces a
configuration property {{yarn.nodemanager.resource.utilization.ratio}} which is
used to simulate the actual resource usage of each NM so that to test perf when
NMs are under different utilization levels, e.g 0.3, 0.5, 0.7 etc. This might
be a gap between two patches, we might need to incorporate.
Please let me know your thoughts. I will hold on committing this until we reach
a conclusion. Thanks.
> SLS supports setting container execution
> ----------------------------------------
>
> Key: YARN-7929
> URL: https://issues.apache.org/jira/browse/YARN-7929
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: scheduler-load-simulator
> Reporter: Jiandan Yang
> Assignee: Jiandan Yang
> Priority: Major
> Attachments: YARN-7929.001.patch, YARN-7929.002.patch,
> YARN-7929.003.patch, YARN-7929.004.patch, YARN-7929.005.patch,
> YARN-7929.006.patch
>
>
> SLS currently support three tracetype, SYNTH, SLS and RUMEN, but trace file
> can not set execution type of container.
> This jira will introduce execution type in SLS to help better simulation.
> This will help the perf testing with regarding to the Opportunistic
> Containers.
> RUMEN has default execution type GUARANTEED
> SYNTH set execution type by field map_execution_type and
> reduce_execution_type
> SLS set execution type by field container.execution_type
> For compatibility set GUARANTEED as default value when not setting above
> fields in trace file
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
