[ 
https://issues.apache.org/jira/browse/BEAM-6678?focusedWorklogId=199276&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-199276
 ]

ASF GitHub Bot logged work on BEAM-6678:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 15/Feb/19 15:08
            Start Date: 15/Feb/19 15:08
    Worklog Time Spent: 10m 
      Work Description: mxm commented on issue #7849: [BEAM-6678] Persist 
watermark holds view in Flink checkpoints
URL: https://github.com/apache/beam/pull/7849#issuecomment-464082960
 
 
   Run Java Flink PortableValidatesRunner Streaming
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


Issue Time Tracking
-------------------

    Worklog Id:     (was: 199276)
    Time Spent: 50m  (was: 40m)

> FlinkRunner does not checkpoint partition view of watermark holds
> -----------------------------------------------------------------
>
>                 Key: BEAM-6678
>                 URL: https://issues.apache.org/jira/browse/BEAM-6678
>             Project: Beam
>          Issue Type: Bug
>          Components: runner-flink
>            Reporter: Maximilian Michels
>            Assignee: Maximilian Michels
>            Priority: Major
>             Fix For: 2.11.0
>
>          Time Spent: 50m
>  Remaining Estimate: 0h
>
> The FlinkRunner does not persist its view of the per-partition Watermark 
> holds. This can lead to elements to be considered late after restoring from a 
> savepoint or resuming a failed pipeline.
> Similar to the approach in BEAM-6650, we can recover the Watermarks by 
> iterating through the keys of the state backend during recovery.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to