stevenzwu commented on issue #2108:
URL: https://github.com/apache/iceberg/issues/2108#issuecomment-1223091861
There are generally two ways. Interesting to get inputs from the community.
* Publish Flink watermark as a snapshot metadata field or table property
* Pro: reuse Flink watermark concept. might seems more natural.
* Con: Is the Flink watermark always a good completion signal for the
Iceberg table?
* Extract watermark signal using min-max column stats for the timestamp
column that is used to compute the table partitions.
* Pro: compute the watermark based on the timestamp field used for table
partition
* Con: maybe a bit more complex to implement and to users
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
