Thanks Kui for driving this topic. I think this FLIP could help users leverage the ability of watermark alignment in Flink SQL when backfilling the data, which is helpful to use stream applications to replace batch applications.
Best Yun Tang ________________________________ From: kui yuan <catye...@gmail.com> Sent: Wednesday, February 22, 2023 10:22 To: dev@flink.apache.org <dev@flink.apache.org> Subject: [DISCUSS] FLIP-296: Watermark options for table API & SQL Hi devs, I'd like to start a discussion thread for FLIP-296[1]. This comes from an offline discussion with @Yun Tang, and we hope to enrich table API & SQL to support many watermark-related features which were only implemented at the datastream API level. Basically, we want to introduce watermark options in table API & SQL via SQL hint named 'WATERMARK_PARAMS' to support features: 1、Configurable watermark emit strategy 2、Dealing with idle sources 3、Watermark alignment Last but not least, thanks to Qingsheng and Jing Zhang for the initial reviews. Looking forward to your thoughts and any feedback is appreciated! [1] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=240884405 Best Yuan Kui
