eshu commented on issue #6058: URL: https://github.com/apache/hudi/issues/6058#issuecomment-1179826164
Current situation with incremental read: Case 1, previous commit time from the incremental reading was 20220706130300379 ``` +-----------------------+------------------------+ |min(updated_at) |min(_hoodie_commit_time)| +-----------------------+------------------------+ |2022-07-10 00:15:00.727|20220710011447293 | +-----------------------+------------------------+ ``` Case 2, previous commit time was 20220706010239483: ``` +-------------------+------------------------+ |min(updated_at) |min(_hoodie_commit_time)| +-------------------+------------------------+ |2019-08-28 08:47:12|20220606081029941 | +-------------------+------------------------+ +-------------------+------------------------+ |min(updated_at) |min(_hoodie_commit_time)| +-------------------+------------------------+ |2022-07-09 18:05:41|20220709185647477 | +-------------------+------------------------+ ``` It looks a cleaner process is involved here. We lost more records from the incremental read. Snapshot read have the same commit times (20220606082430597 and 20220608041038459 respectively). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
