JingsongLi commented on PR #6869:
URL: https://github.com/apache/paimon/pull/6869#issuecomment-3690994980
I think we can just introduce another format.
Lookup Sst file:
```
* +-----------------------------------+------+
* | Footer | |
* +-----------------------------------+ |
* | Index Block | +--> Loaded on open
* +-----------------------------------+ |
* | Bloom Filter Block | +--> Loaded on first Lookup,
memory can be expired
* +-----------------------------------+------+
* | Data Block | |
* +-----------------------------------+ |
* | ...... | +--> Loaded on requested
* +-----------------------------------+ |
* | Data Block | |
* +-----------------------------------+------+
```
BTree Index File:
```
* +-----------------------------------+------+
* | Footer | |
* +-----------------------------------+ |
* | Index Block | +--> Loaded on open
* +-----------------------------------+ |
* | Bloom Filter Block | +--> Loaded on first Lookup,
memory can be expired
* +-----------------------------------+ |
* | Null bitmap Block | +--> Loaded on requested
* +-----------------------------------+------+
* | Data Block | |
* +-----------------------------------+ |
* | ...... | +--> Loaded on requested
* +-----------------------------------+ |
* | Data Block | |
* +-----------------------------------+------+
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
