[
https://issues.apache.org/jira/browse/TEZ-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16003415#comment-16003415
]
Jonathan Eagles commented on TEZ-3274:
--------------------------------------
Hey [~ebadger], the amount of work to commonize the new SlowStartVertexManager
and ShuffleVertexManager + Base isn't going to make up for the gain. Since
broadcast data size is exactly the same regardless of how many tasks, the
auto-reduce code and routing code should be totally ripped out.
> Vertex with MRInput and broadcast input does not respect slow start
> -------------------------------------------------------------------
>
> Key: TEZ-3274
> URL: https://issues.apache.org/jira/browse/TEZ-3274
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Jonathan Eagles
> Assignee: Eric Badger
> Attachments: TEZ-3274.001.patch, TEZ-3274.002.patch,
> TEZ-3274.003.patch
>
>
> Vertices with shuffle input and MRInput choose RootInputVertexManager (and
> not ShuffleVertexManager) and start containers and tasks immediately. In this
> scenario, resources can be wasted since they do not respect
> tez.shuffle-vertex-manager.min-src-fraction
> tez.shuffle-vertex-manager.max-src-fraction.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
