[
https://issues.apache.org/jira/browse/FLINK-20213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239051#comment-17239051
]
zouyunhe commented on FLINK-20213:
----------------------------------
[~lzljs3620320] We found the watermark as below, the time is about 2020-11-25
21:53:02
!image-2020-11-26-12-00-23-542.png!
And we see the data write in hive partition , the _SUCCESS file has been
writeen finished.
!image-2020-11-26-12-00-55-829.png!
But Some in-progress file was not finished, which mean this paritition is not
finished.
> Partition commit is delayed when records keep coming
> ----------------------------------------------------
>
> Key: FLINK-20213
> URL: https://issues.apache.org/jira/browse/FLINK-20213
> Project: Flink
> Issue Type: Bug
> Components: Connectors / FileSystem, Table SQL / Ecosystem
> Affects Versions: 1.11.2
> Reporter: Jingsong Lee
> Assignee: Jingsong Lee
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.12.0, 1.11.3
>
> Attachments: image-2020-11-26-12-00-23-542.png,
> image-2020-11-26-12-00-55-829.png
>
>
> When set partition-commit.delay=0, Users expect partitions to be committed
> immediately.
> However, if the record of this partition continues to flow in, the bucket for
> the partition will be activated, and no inactive bucket will appear.
> We need to consider listening to bucket created.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
