deepakpanda93 commented on issue #4978: URL: https://github.com/apache/hudi/issues/4978#issuecomment-4841932506
Closing this as fixed in Hudi 1.x. Root cause: Hive's input format filters out .-prefixed files, so a MOR file group with only log files and no base parquet (the state before the first compaction) had no readable files, and the realtime input format fell through to a wrong path → TableNotFoundException. Fix: the engine-agnostic HoodieFileGroupReader for Hive, added in [HUDI-6787 / [#10422](https://github.com/apache/hudi/pull/10422)]. It reads file slices (base optional + log files) directly, so a log-only file slice is read natively rather than dropped. It's controlled by hoodie.file.group.reader.enabled, which defaults to true since 1.0.0, making it the default Hive read path in 1.x. This is present in 1.0.0 and all later releases (1.0.x, 1.1.0, 1.1.1, 1.2.0). Reading xxx_rt before the first compaction (log-only file groups) works on these versions. If anyone still reproduces this on a 1.x release, please reopen with the Hudi version and a minimal repro and we'll take another look. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
