rangareddy commented on issue #17321: URL: https://github.com/apache/hudi/issues/17321#issuecomment-5365822929
This issue was reviewed as part of the JIRA-migrated backlog triage (HUDI-8636). **Findings: not done, and it is blocked on a sibling.** The body is JIRA boilerplate only, and no reference to HUDI-8636 exists anywhere in the tree. Context that scopes the work: metadata-table reads now go through `HoodieFileGroupReader` / `HoodieLsmFileGroupReader`, but only for **key lookups** (`HoodieBackedTableMetadata:617`, `:629`, via PR #13544 under HUDI-9592). Compaction needs to read an entire file slice, and there is no such path - `readSliceAndFilterByKeysIntoList` returns early with an `EmptyIterator` when given no keys, with the comment *"otherwise, the hfile lookup will return all records"*. That full-file-slice read capability is exactly what #17393 (HUDI-9130) tracks, and it is still open. So this ticket cannot be implemented until that lands, and the two should be linked so it does not get picked up in the wrong order. Keeping this open. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
