txl2017 opened a new issue, #7312: URL: https://github.com/apache/hudi/issues/7312
we use flinksql insert kafka data into hudi, hudi table type is cow and index is bucket. our data has a field `STATUS`, and `STATUS` value is calculate by Pre-task. if a record not have any data in 6 minutes, we have to change `STATUS` value to 0. in this case, whether we can use hudi with ttl like hbase? when data do compact or merge, trigger a ttlMethod. our idea is that we can add a ttlEvent method in BaseAvroPayload, default do nothing, then we create a new payload Override ttlEvent method, to implements our value change. we can add ttl ConfigOption in FlinkOptions, in FlinkMergeHelper, judge if ttl is set or not, if set, will execute the ttlEvent method after read data from baseFile. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
