[
https://issues.apache.org/jira/browse/FLINK-20671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17252691#comment-17252691
]
Jingsong Lee commented on FLINK-20671:
--------------------------------------
[~ZhuShang]
Thanks for the reporting. I got what you mean.
> In theory,if delay is 0s the partition should be commited on every checkpoint.
The current behavior is to commit once at the beginning and once at the end.
At present, only the commit is guaranteed, not guarantee commit on every
checkpoint.
> Partition doesn't commit until the end of partition
> ---------------------------------------------------
>
> Key: FLINK-20671
> URL: https://issues.apache.org/jira/browse/FLINK-20671
> Project: Flink
> Issue Type: Bug
> Components: Connectors / FileSystem, Table SQL / Ecosystem
> Affects Versions: 1.12.0, 1.11.1
> Reporter: zhuxiaoshang
> Priority: Major
>
> According to DOC
> [https://ci.apache.org/projects/flink/flink-docs-master/dev/table/connectors/filesystem.html#partition-commit]
> the partition can be commited multiple times.
> Actually, the partition is commited until the end of partition.For example
> hourly partition, the 10th partition will be commited at 11 clock, even the
> `sink.partition-commit.delay` is 0s.
> In theory,if delay is 0s the partition should be commited on every checkpoint.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
