steFaiz opened a new pull request, #6927:
URL: https://github.com/apache/paimon/pull/6927
<!-- Please specify the module before the PR name: [core] ... or [flink] ...
-->
### Purpose
In the original design, each BTreeIndexReader only reads one BTree Index
File. So we introduce a lazy reader which can dynamically filter out input
files by predicate. For example, consider following files:
```
+-------------------+ +-------------------+
+-------------------+
| min: 1, max: 10 | | min: 11, max: 20 | | min: 30,
max: 40 |
+-------------------+ +-------------------+
+-------------------+
```
* If the test predicate is EQUAL(15), we only need to read the second file.
* If the test predicate is EQUAL(25), we do not need to read any file.
* so on
<!-- Linking this pull request to the issue -->
Linked issue: https://github.com/apache/paimon/issues/6834
<!-- What is the purpose of the change -->
### Tests
Please see:
* org.apache.paimon.globalindex.btree.BTreeIndexReaderTest for single file
reader
* org.apache.paimon.globalindex.btree.LazyFilteredBTreeIndexReaderTest for
lazy filtered reader
<!-- List UT and IT cases to verify this change -->
### API and Format
None
<!-- Does this change affect API or storage format -->
### Documentation
Will be added in the future
<!-- Does this change introduce a new feature -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
