[ https://issues.apache.org/jira/browse/HUDI-3011 ]
sivabalan narayanan deleted comment on HUDI-3011:
-------------------------------------------
was (Author: shivnarayan):
Actually this is not an issue. Even reading with latest should fetch all the
data. We don't ever delete the entries from our meta hudi table. So, just
setting this config
"hoodie.deltastreamer.source.hoodieincr.read_latest_on_missing_ckpt" to true
should work for us.
> Add support to start incremental consumption from begin time rather than
> latest commit time with S3EventsHoodieIncrSource
> -------------------------------------------------------------------------------------------------------------------------
>
> Key: HUDI-3011
> URL: https://issues.apache.org/jira/browse/HUDI-3011
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: sivabalan narayanan
> Assignee: sivabalan narayanan
> Priority: Major
> Labels: core-flow-ds, sev:normal
>
> with S3EventsHoodieIncrSource, if begin time is not provided to consume from
> 1st meta table, we fallback to latest commit time. we should support starting
> from earliest instant.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
