[
https://issues.apache.org/jira/browse/TEZ-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980261#comment-14980261
]
Jeff Zhang commented on TEZ-2581:
---------------------------------
bq. Is the ordering of DM events and completion events via serializing through
the Vertex not needed anymore? Does the same ordering apply to the event being
sent to the TA -> DM events must be sent before completion events?
Yes, here's DM events must be sent before TA completion event. Will add comment
for that. Besides, the DM events will also be sent to Vertex directly for
performance consideration. DM events can be sent to TA and TA send them to
Vertex for downstream consumption, but may lose performance because we route
the event in dispatcher twice. Will add more comments to explain that.
bq. Event serde code should be in Event or some common place (e.g.
ProtoConverters) - not in RecoverConverters where others will not try to search
for.
This is due to dependency issue. To achieve that, I need to move EventMetaData
from tez-runtime-internal to tez-api
> Umbrella for Tez Recovery Redesign
> ----------------------------------
>
> Key: TEZ-2581
> URL: https://issues.apache.org/jira/browse/TEZ-2581
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Jeff Zhang
> Assignee: Jeff Zhang
> Attachments: TEZ-2581-WIP-1.patch, TEZ-2581-WIP-2.patch,
> TEZ-2581-WIP-3.patch, TEZ-2581-WIP-4.patch, TEZ-2581-WIP-5.patch,
> TEZ-2581-WIP-6.patch, TezRecoveryRedesignProposal.pdf,
> TezRecoveryRedesignV1.1.pdf
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
