[
https://issues.apache.org/jira/browse/TEZ-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14393746#comment-14393746
]
Siddharth Seth commented on TEZ-2268:
-------------------------------------
The description has the problem / scenario.
An Input finds out that all it's events are done - without relying on counts.
A field in a DMEvent would imply modifying the event, which is avoidable in the
AM.
> Add an event to indicate that all events are available
> ------------------------------------------------------
>
> Key: TEZ-2268
> URL: https://issues.apache.org/jira/browse/TEZ-2268
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Siddharth Seth
> Assignee: Siddharth Seth
>
> Instead of relying on event counts, it'll be useful to have a single event
> indicate that all events have been generated.
> We'll have to guarantee ordering of events to be after all events are
> actually sent over.
> EdgeManagers, unless specialized, cannot generate these events. They could,
> however, be linked to source Vertex completion.
> Inputs / Outputs could use this to simplify tracking. Failures are the only
> events which could come in after this - which can be ignored by Inputs if
> they have already fetched the relevant data.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
