Tian Jiang created IOTDB-208:
--------------------------------
Summary: Add bloom filters to TsFile
Key: IOTDB-208
URL: https://issues.apache.org/jira/browse/IOTDB-208
Project: Apache IoTDB
Issue Type: New Feature
Reporter: Tian Jiang
The recent readings remind me that the bloom filter is standard equipment in
K-VDBs. Although IoTDB is not one of them (at least not typically), the bloom
filter still helps a lot in various situations. For example, our recent
experiments gave us an illusion that the time series in a storage group remains
unchanged. However, that is not the case.
Naturally, in real situations, the number of time series grows over time, due
to reasons like adding new gears. The old files do not contain such a time
series. Without the help of bloom filters, we have to check each old file only
to find that there is no such time series. To my knowledge, this may take a lot
of time.
So, I suggest we add a bloom filter (or some more efficient one) to each TsFile
to help skip unwanted files.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)