[
https://issues.apache.org/jira/browse/BEAM-9888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17100133#comment-17100133
]
Jan Lukavský commented on BEAM-9888:
------------------------------------
[~ibzib] is it possible to get this into 2.21.0 release, or is it too late?
This somewhat breaks functionality, but because this is not widely adopted (and
experimental), it might wait for 2.22.0. On the other hand, if this can make it
to the next release, it would be good.
> @RequiresTimeSortedInput might feed data out of order
> -----------------------------------------------------
>
> Key: BEAM-9888
> URL: https://issues.apache.org/jira/browse/BEAM-9888
> Project: Beam
> Issue Type: Bug
> Components: runner-core
> Affects Versions: 2.20.0
> Reporter: Jan Lukavský
> Assignee: Jan Lukavský
> Priority: Major
> Fix For: 2.21.0
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> StatefulDoFnRunner drops late data based on output watermark, but output
> watermark might not advance fast enough to discard data that should have been
> dropped. We have to either:
> a) drop data based on input watermark, or
> b) drop data based on timestamp of last emitted element
> I'm a little in favor of b), because it can drop less data.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
