[
https://issues.apache.org/jira/browse/TEZ-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14252892#comment-14252892
]
Jeff Zhang commented on TEZ-1867:
---------------------------------
[~bikassaha], comments:
* Should we also create a corresponding DrainDispatcher for unit test ?
* I think the original eventHandlers and the new eventDispatchers are
exclusive, should check whether the eventType has been registered in each
others' Map when doing register.
bq. Now its trivial to add other events on their own delegated dispatchers.
If we create own delegated dispatchers for DAG/Vertex/Task/TaskAttempt, we can
not guarantee the event processed order, all the state machine transitions may
happen simultaneously. I think of one potential case that Task Reschedule may
happen when vertex is in the middle of commit. Saying, Vertex is handling
VertexEventTaskCompleted, in the middle of commit. While its Task is in
TaskRetroactiveFailureTransition.
> Create new central dispatcher for Tez AM
> ----------------------------------------
>
> Key: TEZ-1867
> URL: https://issues.apache.org/jira/browse/TEZ-1867
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Bikas Saha
> Assignee: Bikas Saha
> Attachments: TEZ-1867.1.patch
>
>
> The dispatcher should be able to federate events across multiple event
> specific dispatchers for AM control plane scalability. Add dispatcher
> specific thread names for easier debugging.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
