JingsongLi opened a new pull request, #9294: URL: https://github.com/apache/paimon/pull/9294
## What changed - Add Core predicates and builder APIs for `ARRAYS_OVERLAP` and `ARRAY_CONTAINS_ALL`. - Push both predicates into the multivalue bitmap index: overlap unions postings, while contains-all intersects distinct postings. - Preserve safe behavior for null literals, duplicate literals, empty contains-all arguments, incompatible element types, and legacy index metadata. - Propagate the predicates through global-index reader wrappers and primary-key sorted-index scan caching/localization. - Add predicate, serialization, bitmap-reader, scan, and end-to-end table coverage, and update the global-index documentation. ## Why The multivalue index already stores one posting list per non-null array element, so it can answer any-element and all-element membership queries without scanning the full array column. ## Impact Paimon Core callers can construct these predicates through `PredicateBuilder`. SQL connectors still need connector-specific expression translation before engine functions reach these Core predicates. ## Validation - `mvn -q -pl paimon-common -Pfast-build -DwildcardSuites=none -Dtest=PredicateBuilderTest,PredicateJsonSerdeTest,LeafPredicateTest,GlobalIndexEvaluatorTest,MultiValueBitmapIndexReaderTest test` - `mvn -q -pl paimon-core -am -Pfast-build -DfailIfNoTests=false -DwildcardSuites=none -Dtest=MultiValueGlobalIndexTableTest,PrimaryKeySortedIndexScanTest test` - `mvn -q -pl paimon-common,paimon-core,paimon-format -am -DskipTests compile` - `git diff --check` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
