Hi kui Thanks for initializing this discussion. I have two questions
1. What will happen if we add watermark related options in `the connector options`? Will the connector ignore these options or throw an exception? How can we support this? 2. If one table is used by two operators with different watermark params, what will happen? For example, there is a source table T and user submit the following job SELECT T1.id, T1.cnt_val, T2.sum_val FROM (SELECT id, count(val) as cnt_val FROM T /*+ WATERMARK PARAMS(‘rowtime’ = ’time_column’, ‘rowtime_expression’ = ’time_column - INTERVAL 5 SECOND') */ GROUP BY id) T1 JOIN (SELECT id, sum(val) as sum_val FROM T /*+ WATERMARK PARAMS(‘rowtime’ = ’time_column’, ‘rowtime_expression’ = ’time_column - INTERVAL 10 SECOND') */ GROUP BY id) T2 ON T1.id=T2.id Best, Shammon On Wed, Feb 22, 2023 at 11:28 AM 郑舒力 <nezhazh...@gmail.com> wrote: > Hi kui, > > There is a scenario using watermark that cannot be implemented through SQL > now： > We only support specify rowtime column in table DDL，if the rowtime field > is generated by join dimension table , it cannot be implemented > > Can we consider implement through HINTS like : > Select * from t1 join t2 /*+ WATERMARK PARAMS(‘rowtime’ = ’time_column’, > ‘rowtime_expression’ = ’time_column - INTERVAL 5 SECOND') */ > > > > > 2023年2月22日 10:22，kui yuan <catye...@gmail.com> 写道： > > > > Hi devs, > > > > > > I'd like to start a discussion thread for FLIP-296[1]. This comes from an > > offline discussion with @Yun Tang, and we hope to enrich table API & SQL > to > > support many watermark-related features which were only implemented at > the > > datastream API level. > > > > > > Basically, we want to introduce watermark options in table API & SQL via > > SQL hint named 'WATERMARK_PARAMS' to support features: > > > > 1、Configurable watermark emit strategy > > > > 2、Dealing with idle sources > > > > 3、Watermark alignment > > > > > > Last but not least, thanks to Qingsheng and Jing Zhang for the initial > > reviews. > > > > > > Looking forward to your thoughts and any feedback is appreciated! > > > > > > [1] > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=240884405 > > > > > > Best > > > > Yuan Kui > >
