hameizi opened a new pull request #3681: URL: https://github.com/apache/iceberg/pull/3681
If we add watermark in table we can deal data by flink with eventtime, and then we can count stream window with watermark and join with 'version table'(can works in combination https://github.com/apache/iceberg/pull/3095) what flink define. In this PR the information of watermark is stored in table properties so that it will not affect original scheam of iceberg. Below properties will be added in watermark table: 'watermark.0.rowtime'='testTime', 'watermark.0.strategy.data-type'='TIMESTAMP(3)', 'watermark.0.strategy.expr'='`testTime` - INTERVAL \'5\' SECOND' After this PR we can create table set watermark like below sql: CREATE TABLE catalog.database.table( id BIGINT COMMENT 'unique id', data STRING, testTime TIMESTAMP(3), PRIMARY KEY(id) NOT ENFORCED, WATERMARK FOR testTime AS testTime - INTERVAL '5' SECOND ) with ('format-version' = '2' ); -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
