deepakpanda93 commented on issue #14678: URL: https://github.com/apache/hudi/issues/14678#issuecomment-5116136636
This issue was reviewed as part of the JIRA-migrated backlog triage. **Findings:** this is available. Incremental queries take an explicit format option - `hoodie.datasource.query.incremental.format` (`hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala:70-78`, `sinceVersion` **0.13.0**): - `latest_state` (default) - returns the latest record values, i.e. log records merged with the base file, which is the behaviour requested here - `cdc` - returns change-data records only On MOR the merge itself is done by `HoodieFileGroupReader` driven by `IncrementalQueryAnalyzer` (`hudi-common/src/main/java/org/apache/hudi/common/table/read/`), so a partial log block no longer yields partial rows under `latest_state`. Closing as fixed. Please reopen if you need merge-with-base semantics in a context this option doesn't cover. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
