sleapfish edited a comment on issue #2522: URL: https://github.com/apache/hudi/issues/2522#issuecomment-772668176
@nsivabalan That is correct! But maybe if you have control over source but let's say that you do something like extracting data from it with a rolling window of -3 days. And there is a case where some of the records from -3 days could change, but most of the records wouldn't. I want to commit only changed/new records to target Hudi table. When I do incremental query I don't want all 3 days worth of data in it, even tho only small portion of it actually changed ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
