luoyuxia created FLINK-22993:
--------------------------------
Summary: CompactFileWriter won't emit EndCheckpoint with
Long.MAX_VALUE checkpointId
Key: FLINK-22993
URL: https://issues.apache.org/jira/browse/FLINK-22993
Project: Flink
Issue Type: Bug
Components: Connectors / FileSystem, Connectors / Hive
Affects Versions: 1.13.0
Reporter: luoyuxia
Fix For: 1.14.0
CompactFileWriter won't emit EndCheckpoint with Long.MAX_VALUE checkpointId
even though the inputs end.
It will cause data lose. For example, after completing checkpoint 5,
CompactFileWriter write some file, then the inputs end, but it won't emit
EndCheckpoint with Long.MAX_VALUE checkpointId, so the downstream operator
won't do the compaction for the files which means these files are invisible.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
