sivabalan narayanan created HUDI-6684:
-----------------------------------------
Summary: Follow up/ fix missing records from bloom filter
partition in MDT
Key: HUDI-6684
URL: https://issues.apache.org/jira/browse/HUDI-6684
Project: Apache Hudi
Issue Type: Improvement
Components: metadata
Reporter: sivabalan narayanan
As of now, if a bloom filter for a file is missing from bloom filter partition
in MDT, we ignore it.
HoodieMetadataTableUtil
{code:java}
// If reading the bloom filter failed then do not add a record for this file
if (bloomFilterBuffer == null) {
LOG.error("Failed to read bloom filter from " + addedFilePath);
return Stream.<HoodieRecord>empty().iterator();
}
} {code}
we should think about on what scenario, this is possible and how exactly we can
handle such situations.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
