[
https://issues.apache.org/jira/browse/TEZ-2020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306597#comment-14306597
]
Bikas Saha commented on TEZ-2020:
---------------------------------
Branch-0.6
commit 83b5c70145e77bd5b3b5450477b3796d627369cb
Author: Bikas Saha <[email protected]>
Date: Wed Feb 4 19:48:19 2015 -0800
TEZ-2020. For 1-1 edge vertex configured event may be sent incorrectly
(bikas)
(cherry picked from commit b804b8f03e9d7934202f3838841fe1abb416f480)
Branch-0.5
commit 363249d6455d34605c361480685d41165b9118b1
Author: Bikas Saha <[email protected]>
Date: Wed Feb 4 19:48:19 2015 -0800
TEZ-2020. For 1-1 edge vertex configured event may be sent incorrectly
(bikas)
(cherry picked from commit b804b8f03e9d7934202f3838841fe1abb416f480)
Conflicts: Resolved by keeping incoming change
tez-dag/src/main/java/org/apache/tez/dag/app/dag/impl/VertexImpl.java
> For 1-1 edge vertex configured event may be sent incorrectly
> ------------------------------------------------------------
>
> Key: TEZ-2020
> URL: https://issues.apache.org/jira/browse/TEZ-2020
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Bikas Saha
> Assignee: Bikas Saha
> Fix For: 0.5.4
>
> Attachments: TEZ-2020.1.patch, synthetic_job.png
>
>
> For a fully configured 1-1 vertex configured event will be sent after init
> because the vertex manager does not signal intent to reconfigure. However a
> change in parallelism upstream on the 1-1 edge can cause this vertex's
> parallelism to be updated accordingly. This breaks the guarantee that
> configured should be sent after vertex is fully configured. This is because
> update of parallelism on 1-1 edge has until now been hard-coded in the Vertex
> code. This can be removed now with the InputReadyVertexManager handling the
> 1-1 edge and the addition of vertex state updates. Not only will this fix the
> issue but also remove the special handling for 1-1 edges in the AM which
> should not be there for cleanliness.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
