JerryYue-M commented on PR #7099: URL: https://github.com/apache/hudi/pull/7099#issuecomment-1338700017
> Can we fetch the event time through the payload clazz event time field we the `HoodieRecordPayload#getInsertValue` is invoked ? And we can finalize the max timestamp in the coordinator when commit the metadata. @danny0405 thanks for your suggestion, it's import for me the reason why i think we need implement in this way is : 1. I think this is a lightweight and common behavior, no matter what type of payload it is used. if we implement this base on payload, it may be limited by payload class between flink and spark/presto eg. 2. for later we may need to add some metric for the flink write function eg: processing latency metric , and also need to extract the timestamp from the record 3. implement base payload may change some code in common module such as modify the HoodieAppendHandler or HoodieMergeHandler -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
