GitHub user LiuQhahah added a comment to the discussion: Cuckoo Filter Design Proposal
> Hi @LiuQhahah , I just have one concern about the design. Would the > performance significantly downgraded if we have too many sub filters with > frequent adding? You raise a valid concern about performance degradation with multiple sub-filters. Here's my analysis and proposed solution: **The Challenge** Yes, with the current implementation, query performance degrades linearly with the number of sub-filters. For example, with 20 sub-filters, an EXISTS query needs to check 40 buckets (2 per filter), resulting in 40 separate RocksDB read operations. **Proposed Solution: Leverage RocksDB's MultiGet** The key optimization is to utilize RocksDB's native MultiGet API, which can dramatically improve query performance GitHub link: https://github.com/apache/kvrocks/discussions/3079#discussioncomment-15558736 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
