Hemanth Boyina created SPARK-60356:
--------------------------------------
Summary: Support left semi and left anti join pushdown for DSv2
Key: SPARK-60356
URL: https://issues.apache.org/jira/browse/SPARK-60356
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 5.0.0
Reporter: Hemanth Boyina
DSv2 join pushdown currently supports inner, left outer, and right outer joins.
Left semi and left anti joins are executed in Spark even when the underlying
database can handle them.
Add these join types to the connector API and support JDBC pushdown using
EXISTS and NOT EXISTS. Also allow simple correlated existence subqueries to
reach join pushdown.
The result should contain only
left-side columns, while preserving duplicate and null semantics. Null-aware
NOT IN is outside the scope of this change.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
