GitHub user mgaido91 opened a pull request:
https://github.com/apache/spark/pull/21331
[SPARK-24276][SQL] Order of literals in IN should not affect semantic
equality
## What changes were proposed in this pull request?
When two `In` operators are created with the same list of values, but
different order, we are considering them as semantically different. This is
wrong, since they have the same semantic meaning.
The PR adds a canonicalization rule which orders the literals in the `In`
operator so the semantic equality works properly.
## How was this patch tested?
added UT
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/mgaido91/spark SPARK-24276
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21331.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21331
----
commit 9595237a3178de7fb4c8e280a55072ed050fffc3
Author: Marco Gaido <marcogaido91@...>
Date: 2018-05-15T12:13:39Z
[SPARK-24276][SQL] Order of literals in IN should not affect semantic
equality
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
