[
https://issues.apache.org/jira/browse/TEZ-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105691#comment-14105691
]
Siddharth Seth commented on TEZ-1448:
-------------------------------------
Looks good. Last little bit; I think the default for SortedMergedInput needs to
be higher than SortedOutput (or at least equal) . Typically, there's more tasks
for the SortedOutput - so the memory pressure per task should be lower - at
least across tasks.
> Make WeightedScalingMemoryDistributor as the default memory distributor
> -----------------------------------------------------------------------
>
> Key: TEZ-1448
> URL: https://issues.apache.org/jira/browse/TEZ-1448
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Rajesh Balamohan
> Assignee: Rajesh Balamohan
> Attachments: TEZ-1448.1.patch, TEZ-1448.2.patch
>
>
> Currently Tez uses ScalingAllocator; WeightedScalingMemoryDistributor
> provides better control over ScalingAllocator.
> In certain DAG executions, response time improvements of over 6% have been
> observed at 10 TB scale and ~26% runtime improvement in memory intensive
> reducers.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
