yihua opened a new pull request, #6955: URL: https://github.com/apache/hudi/pull/6955
### Change Logs By default, the default maximum number of instants to fetch in incremental source (`hoodie.deltastreamer.source.hoodieincr.num_instants`) is 1. The checkpoint of the target Hudi table from the incremental ETL lags behind the source if the ingestion runs at a lower frequency than the source or the ingestion job stalls for some time, causing the data freshness issue. This PR increases default num_instants so that the incremental ETL can fetch more instants to catch up with the source. ### Impact **Risk level: low** Only in the cases mentioned above, more instants are fetched for catchup. ### Documentation Update N/A. The default value is automatically updated on the Hudi website once the website is built for a new release. ### Contributor's checklist - [ ] Read through [contributor's guide](https://hudi.apache.org/contribute/how-to-contribute) - [ ] Change Logs and Impact were stated clearly - [ ] Adequate tests were added if applicable - [ ] CI passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
