Github user ioana-delaney commented on the issue:
https://github.com/apache/spark/pull/13570
@hvanhovell The EXISTS/NOT EXISTS predicates will have an empty condition.
e.g.
select c1 from t1 where EXISTS (select c2 from t2)
== Optimized Logical Plan ==
Project [_1#224 AS c1#227]
+- Join LeftSemi
:- LocalRelation [_1#224, _2#225]
+- LocalRelation [c2#239]
But the other subquery predicates are quaranteed to have at least one
condition.
Regarding the rewriteExistentialExpr interface, I think that I need to pass
an expression instead of a sequence of conditions since the last case in the
main rewrite rule does not have conditions. It's just an expression. e.g. where
(case when c2 IN (select 1 as one) then 1 else 2) = c1
Please let me know. Thanks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
