mazhengxuan created HBASE-30509:
-----------------------------------

             Summary: Deduplicate overlapping row-key scans and point lookups 
in Spark connectors
                 Key: HBASE-30509
                 URL: https://issues.apache.org/jira/browse/HBASE-30509
             Project: HBase
          Issue Type: Sub-task
          Components: hbase-connectors
            Reporter: mazhengxuan


RowKeyFilter.mergeUnion can retain point lookups that are already covered by 
scan ranges.

For a filter such as key < 'm' OR key = 'a', this can read the same row through 
both a ScanĀ and a Get and produce duplicate results.

We should deduplicate point lookups and remove those covered by scan ranges 
before executing the reads, with regression tests for overlapping OR 
conditions, repeated points and range boundaries in both Spark 3 and Spark 4.



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

Reply via email to