[
https://issues.apache.org/jira/browse/TEZ-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14222745#comment-14222745
]
Jeff Zhang commented on TEZ-992:
--------------------------------
Currently I put commit and recovery data logging in the same thread-pool, I was
thinking whether it is necessary to separate them in different thread-pool so
that it could be helpful to implement an async RecoveryStore (TEZ-993)
[~hitesh], [~bikassaha] Please help review the initial design when you have
time.
> Recovery data should not be written on AsyncDispatcher thread
> -------------------------------------------------------------
>
> Key: TEZ-992
> URL: https://issues.apache.org/jira/browse/TEZ-992
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: Bikas Saha
> Assignee: Jeff Zhang
> Attachments: DAG_FinishSaving.gv, DAG_FinishSaving_2.gv,
> TEZ-992.patch, Vertex_FinishSaving.gv, Vertex_FinishSaving_2.gv
>
>
> This may block the DAG operations in case the recovery data needs to be
> synchronously stored. The operations requiring this blocking operation should
> change their state machines to wait for the store operation before moving
> ahead. They will move ahead after they receive notification from the
> RecoveryService that their operation has completed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
