[
https://issues.apache.org/jira/browse/TEZ-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15832327#comment-15832327
]
Zhiyuan Yang commented on TEZ-3458:
-----------------------------------
[~kshukla], [~mingma], sorry for the problem. Indeed it's caused by auto
grouping, because this test is tightly bound with number of tasks. With auto
grouping patch in, auto grouping is enabled by default and affects this test.
This also reminds me, probably we don't want to enable auto grouping by
default, like in ShuffleVertexMananger. I'll upload additional patch for this.
> Auto grouping for cartesian product edge(unpartitioned case)
> ------------------------------------------------------------
>
> Key: TEZ-3458
> URL: https://issues.apache.org/jira/browse/TEZ-3458
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Zhiyuan Yang
> Assignee: Zhiyuan Yang
> Fix For: 0.9.0
>
> Attachments: TEZ-3458.1.patch, TEZ-3458.2.patch, TEZ-3458.3.patch,
> TEZ-3458.4.patch, TEZ-3458.5.patch, TEZ-3458.6.patch
>
>
> Original CartesianProductVertexManagerUnpartitioned set parallelism as
> product of all source vertices parallelism which may explode to insane
> number. We should do auto reduce as in ShuffleVertexManager to avoid this.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
