[
https://issues.apache.org/jira/browse/TEZ-1345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114025#comment-14114025
]
Hitesh Shah commented on TEZ-1345:
----------------------------------
bq. So overall IMO, I prefer to ignore the init events in recovery log and call
initializer again in recovery. It only affect the performance of recovery while
the method of adding check in canInitVertex would affect the performance of
normal run of dag. Hitesh Shah, Bikas Saha What's your thoughts ?
If you do this, this will result in the vertex starting from scratch. Even
completed tasks will have to be dropped as there is no guarantee that the
initializer will generate the same events and assign them in the same to the
tasks.
> Add checks to guarantee all init events are written to recovery to consider
> vertex initialized
> ----------------------------------------------------------------------------------------------
>
> Key: TEZ-1345
> URL: https://issues.apache.org/jira/browse/TEZ-1345
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Hitesh Shah
> Assignee: Jeff Zhang
> Attachments: Tez-1345-2.patch, Tez-1345.patch
>
>
> Related to issue discovered in TEZ-1033
--
This message was sent by Atlassian JIRA
(v6.2#6252)
