[
https://issues.apache.org/jira/browse/TEZ-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Adrian Nicoara updated TEZ-3983:
--------------------------------
Description:
A VertexGroup is described to act as a union of multiple vertices.
Consider a VertexGroup composed of 2 vertices, each with 2 tasks. If this is a
union, then the expectation is that the VertexGroup has 4 tasks. A ONE_TO_ONE
edge, to a downstream vertex, must then require that vertex to also have 4
tasks.
This is not the case, as evidenced by the [following
test|[https://github.com/apache/tez/blob/master/tez-api/src/test/java/org/apache/tez/dag/api/TestDAGVerify.java#L779-L831]].
Rather, what happens is that implementation (of unrolling the VertexGroup and
directly creating edges between the components of the VertexGroup and the
downstream vertices) is presented as the behavior.
was:
A VertexGroup is described to act as a union of multiple vertices.
Consider a VertexGroup composed of 2 vertices, each with 2 tasks. If this is a
union, then the expectation is that the VertexGroup has 4 tasks. A ONE_TO_ONE
edge, to a downstream vertex, must then require that vertex to also have 4
tasks.
This is not the case, as evidenced by the [following
test|[https://github.com/apache/tez/blob/master/tez-api/src/test/java/org/apache/tez/dag/api/TestDAGVerify.java#L779-L831].]
Rather, what happens is that implementation (of unrolling the VertexGroup and
directly creating edges between the components of the VertexGroup and the
downstream vertices) is presented as the behavior.
> VertexGroup ONE_TO_ONE edges do not produce the right graph
> -----------------------------------------------------------
>
> Key: TEZ-3983
> URL: https://issues.apache.org/jira/browse/TEZ-3983
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Adrian Nicoara
> Priority: Major
>
> A VertexGroup is described to act as a union of multiple vertices.
> Consider a VertexGroup composed of 2 vertices, each with 2 tasks. If this is
> a union, then the expectation is that the VertexGroup has 4 tasks. A
> ONE_TO_ONE edge, to a downstream vertex, must then require that vertex to
> also have 4 tasks.
> This is not the case, as evidenced by the [following
> test|[https://github.com/apache/tez/blob/master/tez-api/src/test/java/org/apache/tez/dag/api/TestDAGVerify.java#L779-L831]].
> Rather, what happens is that implementation (of unrolling the VertexGroup and
> directly creating edges between the components of the VertexGroup and the
> downstream vertices) is presented as the behavior.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
