nsivabalan edited a comment on issue #2178: URL: https://github.com/apache/hudi/issues/2178#issuecomment-710031904
If you wish to scale the bloom filer size along with the number of entries, you can try out dynamic bloom filter. Remember this is different from hoodie.index.type which refers to BLOOM/GLOBAL_BLOOM, etc. The config of interest is hoodie.bloom.index.filter.type = SIMPLE/DYNAMIC_V0 for DYNAMIC_V0, you need to set an extra config. hoodie.bloom.index.filter.dynamic.max.entries Basically the bloom will be initialized based on hoodie.index.bloom.num_entries. but as number of entries added reaches this value, bloom dynamically scales and increases its bitsize. This goes on upto "hoodie.bloom.index.filter.dynamic.max.entries". So, until this the ffp will be honored. After this the ffp may not be honored as the bloom may not grow beyond this. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
