[
https://issues.apache.org/jira/browse/HUDI-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-1295:
--------------------------------------
Description:
Idea here to maintain our bloom filters outside of parquet for speedier access
from bloom.
- Design and impl bloom filter migration to metadata table.
Design:
schema for the payload:
key: partitionName_fileName
payload schema:
isDeleted (boolean): true/false
bloom_type: short
ser_bloom: byte[] representing serialized bloom filter.
was:Idea here to maintain our bloom filters outside of parquet for speedier
access from bloom. index
> Track bloom filters as a part of metadata table
> -----------------------------------------------
>
> Key: HUDI-1295
> URL: https://issues.apache.org/jira/browse/HUDI-1295
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: Writer Core
> Affects Versions: 0.9.0
> Reporter: Vinoth Chandar
> Assignee: Manoj Govindassamy
> Priority: Blocker
> Fix For: 0.10.0
>
>
> Idea here to maintain our bloom filters outside of parquet for speedier
> access from bloom.
>
> - Design and impl bloom filter migration to metadata table.
> Design:
> schema for the payload:
> key: partitionName_fileName
> payload schema:
> isDeleted (boolean): true/false
> bloom_type: short
> ser_bloom: byte[] representing serialized bloom filter.
>
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
