huyuanfeng2018 opened a new issue, #2957: URL: https://github.com/apache/incubator-paimon/issues/2957
### Search before asking - [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar. ### Motivation PaimonSink Commit has a logic that if no data is written during a checkpoint cycle, no snapshot will be generated. Let me give you an example: If I read a kafka stream and write it to Paimon, there may be filters in the middle, and flink watermarks are generated at the same time. Then each snapshot of Paimon will have watermark information. I can judge my writing progress through the watermark of the latest snapshot. , if the watermark is advancing in a checkpoint interval, but the filter logic filters out the data, a snapshot will not be generated, but the watermark should be advancing. Currently, forced snapshot generation only takes effect when the automatic tag creation configuration is enabled and certain conditions are met. I think we should make this a switchable option. ### Solution Make `forceCreatingSnapshot` a toggle option for paimon ### Anything else? _No response_ ### Are you willing to submit a PR? - [X] I'm willing to submit a PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
