rangareddy commented on issue #17033: URL: https://github.com/apache/hudi/issues/17033#issuecomment-5391449298
This issue was reviewed as part of the JIRA-migrated backlog triage (HUDI-9467). **Findings: still open.** The concern is that the properties handed to the file group reader for the metadata table are defaults rather than values chosen for MDT. Confirmed the shape exists on `master`: `HoodieBackedTableMetadata` builds a `HoodieAvroReaderContext` and passes `fileGroupReaderProps` into `HoodieFileGroupReader` / `HoodieLsmFileGroupReader` (around `:607-640`), with a reuse path that asserts the predicate is `Predicates.In` (`:603`). To make this actionable it needs the specific properties in question named - buffer sizes, merge type, spillable-map settings are the usual candidates - since "revisit the defaults" cannot be verified or closed. Related: #17035 (HUDI-9477) revisits MDT compaction planning, in the same area. Keeping this open. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
