JingsongLi opened a new pull request, #9986:
URL: https://github.com/apache/paimon/pull/9986

   ### Purpose
   
   Prevent BTree scalar-index lookups on data-evolution tables from making 
broad or fragmented queries slower than a regular data scan.
   
   - Add a query-wide decoded RowID budget shared by BTree readers and abandon 
the complete lookup when exceeded.
   - Fall back to a regular data scan when index candidates exceed the 
configured selection ratio or range-count limit.
   - Apply the guards to FAST, FULL, and DETAIL modes; document that FAST 
fallback may include matches outside current index coverage.
   - Convert Roaring bitmaps to ranges with an early fragmentation limit.
   - Cache null-bitmap cardinality safely for concurrent readers.
   
   ### Tests
   
   - BtreeGlobalIndexTableTest and DataEvolutionBatchScanTest: 34 tests passed.
   - Relevant paimon-common global-index suites: 350 tests passed.
   - mvn -q -pl paimon-api,paimon-common,paimon-core -am -DskipTests compile
   - git diff --check


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to