Hi all,
We maintain an Open-sourced project for protobuf data processing using Flink dagger <http://github.com/odpf/dagger>. But we are currently on Flink-1.9 and want to migrate to the latest stable 1.14. In the older version, we use `*StreamTableSource` *and ` *DefinedRowtimeAttributes` *APIs for Table-source definition, similar to this <https://ci.apache.org/projects/flink/flink-docs-release-1.9/zh/dev/table/streaming/time_attributes.html#using-a-tablesource-1>. But since these APIs are deprecated we are now defining via *APIExpressions* . The issue for us is while defining WatermarkStrategy, more specifically for the `*PreserveWatermarks*` strategy. We can not find an alternative to this, though other WatermarkStrategies like `*BoundedOutOfOrderTimestamps`*could be found in the newer API definition in ` *org.apache.flink.api.common.eventtime.WatermarkStrategy*` package. Currently, we have logic something like in *DefinedRowtimeAttributes* : @Override public *List<RowtimeAttributeDescriptor> *getRowtimeAttributeDescriptors*() {* * WatermarkStrategy *ws = enablePerPartitionWatermark ? new PreserveWatermarks*() *: new BoundedOutOfOrderTimestamps*(*watermarkDelay*)*; return *Collections*.*singletonList**(* new RowtimeAttributeDescriptor*(*rowTimeAttributeName, new ExistingField*(*rowTimeAttributeName*)*, ws*))*; *}* We want to use *PreserveWatermarks *in places since while Backfilling historical data using flink we want to use underlying Watermark defined in Kafka Consumer-level instead of Sources as it will prevent us from data drops. Is there any alternate in the new APIs we can use? Or else what can we use to get the desired behaviour. Thanks a lot, in advance!
