[
https://issues.apache.org/jira/browse/TEZ-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15622970#comment-15622970
]
Siddharth Seth commented on TEZ-3269:
-------------------------------------
Will take a look, hopefully, soon.
bq. Will the parallelism ever end up getting increased?
bq. yes. When FairRoutingType#FAIR_PARALLELISM is used, there will be multiple
destination tasks processing the same partition and each destination task will
process a range of source tasks of that partition.
I'm not sure increasing the parallelism of a vertex, beyond the initial value
(other than -1) is supported yet. Will need to take a look.
> Provide basic fair routing and scheduling functionality via custom
> VertexManager and EdgeManager
> ------------------------------------------------------------------------------------------------
>
> Key: TEZ-3269
> URL: https://issues.apache.org/jira/browse/TEZ-3269
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Ming Ma
> Assignee: Ming Ma
> Attachments: TEZ-3269-2.patch, TEZ-3269-3.patch, TEZ-3269-4.patch,
> TEZ-3269-5.patch, TEZ-3269.patch
>
>
> With TEZ-3206 and TEZ-3216, we can build a custom VertexManager and
> EdgeManager that uses partition stats to do fair routing as well as the
> scheduling based on destination tasks’ dependency on source tasks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
