[
https://issues.apache.org/jira/browse/SPARK-12660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15085788#comment-15085788
]
Xiao Li commented on SPARK-12660:
---------------------------------
I am also highly interested in this JIRA. Maybe I can take this too. : )
Recently, I implemented an anti-join using outer join with filters, although I
did not submit a PR after realizing anti-join will be supported by a new
physical operator.
> Rewrite except using anti-join
> ------------------------------
>
> Key: SPARK-12660
> URL: https://issues.apache.org/jira/browse/SPARK-12660
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Reynold Xin
>
> Similar to SPARK-12656, we can rewrite except in the logical level using
> anti-join. This way, we can take advantage of all the benefits of join
> implementations (e.g. managed memory, code generation, broadcast joins).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
