vinishjail97 opened a new pull request, #818: URL: https://github.com/apache/incubator-xtable/pull/818
## Summary - In `computeColumnStatsFromMetadataTable`, files absent from the metadata table's column stats index were silently returned with empty `columnStats` and `recordCount=0`, causing downstream consumers to treat valid files as empty - After fetching stats from the metadata table, files with empty `columnStats` are now detected and re-processed via `computeColumnStatsFromParquetFooters` - A `WARN` log is emitted when the fallback is triggered, providing visibility into metadata table gaps ## Test plan - [x] Existing `TestHudiFileStatsExtractor` tests pass - [x] New test: all metadata stats missing — falls back to parquet footers - [x] New test: partial metadata stats missing — only missing files fall back to parquet footers Port of https://github.com/onehouseinc/onetable-internal/pull/263 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
