Zouxxyy opened a new pull request, #8300: URL: https://github.com/apache/paimon/pull/8300
### Purpose Replace the eager `InMemoryFileIndex` (which recursively lists all files at construction time) with `LazyPartitionPruningFileIndex` that defers file listing until `listFiles()` is called and prunes partition directories level-by-level using partition filters. For a table with 20×30=600 partitions, querying a single partition (`p1=1 AND p2=1`) now discovers 1 file instead of 600. Range queries (`p1>15`) and non-leading column filters (`p2=1`) also benefit from per-level pruning. ### Tests Added 4 tests in `FormatTableTestBase`: - Engine static/dynamic partition overwrite correctness - Partition pruning on multi-level partitions (equality, range, non-leading, combined filters) - Partition pruning with all basic types (INT, BIGINT, SMALLINT, TINYINT, FLOAT, DOUBLE, DECIMAL, STRING, BOOLEAN, DATE, TIMESTAMP) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
