JackeyLee007 opened a new issue, #5068:
URL: https://github.com/apache/paimon/issues/5068

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/apache/paimon/issues) 
and found nothing similar.
   
   
   ### Motivation
   
   When doing cdc sync database with flink action, that would be helpful if the 
ingest times are recorded. 
   Ingest times means when the record are created(+I), and when the record are 
updated (mainly+U, -D, but +I also does). 
   
   
   
   ### Solution
   
   To do so, two special computed columns could be empolyeed. One could be 
`etl_create_time`, only set when rowkind is +I. Another could be 
`etl_update_time`, set whenever new records come in. 
   
   And to achieve that, a new special expression should be introduced too.  The 
expression should compute the time according to rowkind.
   
   * If it's used for `etl_create_time`, only returns the current timestamp 
when rowkind is '+I', otherwise null.
   * If it's used for `etl_update_time` returns the current timestamp whenever 
called. 
   
   ### Anything else?
   
   Another solution is recording the ingest times in audit_log. (refer to 
https://github.com/apache/paimon/issues/5022)
   But that would affect paimon-core, and break some assumption.
   
   
   ### Are you willing to submit a PR?
   
   - [x] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to