GitHub user mgaido91 opened a pull request:
https://github.com/apache/spark/pull/21403
[SPARK-24313][WIP][SQL] Support IN subqueries with struct type
## What changes were proposed in this pull request?
Using struct types in subqueries with the `IN` clause can generate invalid
plans in `RewritePredicateSubquery`. Indeed, we do not support the cases when
the outer value is a struct or the output of the inner subquery is a struct. We
only support the case when the output value is a simple value or a struct
created in that place and the output of the subquery is a simple value or a
list of values.
## How was this patch tested?
Added UT
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mgaido91/spark SPARK-24313
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21403.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21403
----
commit 5b6226fa48d82b461c6d5a8d1a9a625d2617af76
Author: Marco Gaido <marcogaido91@...>
Date: 2018-05-22T22:08:22Z
[SPARK-24313][SQL] Support IN subqueries with struct type
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
