mazhengxuan created HBASE-30509:
-----------------------------------
Summary: Deduplicate overlapping row-key scans and point lookups
in Spark connectors
Key: HBASE-30509
URL: https://issues.apache.org/jira/browse/HBASE-30509
Project: HBase
Issue Type: Sub-task
Components: hbase-connectors
Reporter: mazhengxuan
RowKeyFilter.mergeUnion can retain point lookups that are already covered by
scan ranges.
For a filter such as key < 'm' OR key = 'a', this can read the same row through
both a ScanĀ and a Get and produce duplicate results.
We should deduplicate point lookups and remove those covered by scan ranges
before executing the reads, with regression tests for overlapping OR
conditions, repeated points and range boundaries in both Spark 3 and Spark 4.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)