Hi, On re-ingesting, do you mean to say you want to overwrite the table, while not getting the changes in the incremental query? This has not come up before. As you can imagine, it'd tricky scenario, where we need some special handling/action type introduced.
yes, yes on the next two questions. Commit. time can be controlled if using the HoodieWriteClient API, not on datasource/deltastreamer atm On Thu, Aug 13, 2020 at 12:13 AM Sivaprakash <[email protected]> wrote: > Hi, > > > What is the design that can be used/implemented when we re-ingest the data > without affecting incremental query? > > > > - Is it possible to maintain a delta dataset across partitions ( > hoodie.datasource.write.partitionpath.field) ? In my case it is a date. > - Can I do a snapshot query on across and specific partitions? > - Or, possible to control Hudi's commit time? > > > Thanks >
