shangxinli commented on PR #19080: URL: https://github.com/apache/hudi/pull/19080#issuecomment-4833574220
Thanks @yihua — #19071 and #19083 cover the generic HBase-reader → native multi-block path (point lookup, `seekBefore`, full scan, byte-parity, NONE+GZIP), which is the bulk of what this PR was originally guarding. The piece still not covered there: those tests exercise a single generic multi-block file. MDT writes files with five distinct key/value sizing profiles (`FILES`, `COLUMN_STATS`, `RECORD_INDEX`, `SECONDARY_INDEX`, `BLOOM_FILTERS`) and the trailer index layout is per-file based on actual key/value sizes — a future writer change that only perturbs one shape's sizing would slip past the generic tests. I've rescoped this PR to just that parameterized MDT-shape sweep, stacked on #19083. Happy to fold it into #19083 directly if you'd rather, just say the word and I'll close this and send a patch there. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
