[
https://issues.apache.org/jira/browse/HUDI-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Y Ethan Guo updated HUDI-6684:
------------------------------
Fix Version/s: 1.0.2
> Follow up/ fix missing records from bloom filter partition in MDT
> -----------------------------------------------------------------
>
> Key: HUDI-6684
> URL: https://issues.apache.org/jira/browse/HUDI-6684
> Project: Apache Hudi
> Issue Type: Improvement
> Components: metadata
> Reporter: sivabalan narayanan
> Priority: Major
> Fix For: 1.0.2
>
>
> As of now, if a bloom filter for a file is missing from bloom filter
> partition in MDT, we ignore it.
> HoodieMetadataTableUtil
> {code:java}
> // If reading the bloom filter failed then do not add a record for this file
> if (bloomFilterBuffer == null) {
> LOG.error("Failed to read bloom filter from " + addedFilePath);
> return Stream.<HoodieRecord>empty().iterator();
> }
> } {code}
> we should think about on what scenario, this is possible and how exactly we
> can handle such situations.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
