GitHub user bogdanrdc opened a pull request:
https://github.com/apache/spark/pull/18455
[SPARK-21228][SQL] InSet incorrect handling of structs
## What changes were proposed in this pull request?
When data type is struct, InSet now uses TypeUtils.getInterpretedOrdering
(similar to EqualTo) to build a TreeSet. In other cases it will use a HashSet
as before (which should be faster). Similarly, In.eval uses Ordering.equiv
instead of equals.
## How was this patch tested?
New test in SQLQuerySuite.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/bogdanrdc/spark SPARK-21228
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/18455.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #18455
----
commit 03a4281751e02acd2b97ceff6cf8e1621e83eb93
Author: Bogdan Raducanu <[email protected]>
Date: 2017-04-20T10:59:49Z
fix + test
commit 72cf1d117890abe45aa30c6b91a7e2c527fc4969
Author: Bogdan Raducanu <[email protected]>
Date: 2017-04-20T11:01:40Z
reverted mistake commit
commit 2c96a8d65059db3b808e05241b870ccd17937095
Author: Bogdan Raducanu <[email protected]>
Date: 2017-05-12T15:24:57Z
erge remote-tracking branch 'upstream/master'
commit fa11b0b97b38bb98b599a8edf1d43e01b067a926
Author: Bogdan Raducanu <[email protected]>
Date: 2017-05-23T11:28:34Z
Merge remote-tracking branch 'upstream/master'
commit 21ad3aa4468b58aa4e552e2922e1bceda61097f7
Author: Bogdan Raducanu <[email protected]>
Date: 2017-05-23T11:28:57Z
Merge remote-tracking branch 'upstream/master'
commit 7f78cce9d6869371e2e28ce5d9fc4766d7dbc3de
Author: Bogdan Raducanu <[email protected]>
Date: 2017-06-06T11:19:35Z
Merge remote-tracking branch 'upstream/master'
commit eea2e5d466558aa3f2f6232024e8150dc246ba8a
Author: Bogdan Raducanu <[email protected]>
Date: 2017-06-07T10:35:37Z
Merge remote-tracking branch 'upstream/master'
commit b30788eac9df5e76863393826230481e23e52550
Author: Bogdan Raducanu <[email protected]>
Date: 2017-06-16T10:49:48Z
Merge remote-tracking branch 'upstream/master'
commit 38a0347e3079a3e56d70b77f5e25994497eabe41
Author: Bogdan Raducanu <[email protected]>
Date: 2017-06-27T10:33:10Z
Merge remote-tracking branch 'upstream/master'
commit 1057abe6262353093ccf9b75ed24ed54fdfc0095
Author: Bogdan Raducanu <[email protected]>
Date: 2017-06-28T12:35:12Z
Merge remote-tracking branch 'upstream/master'
commit a1bceda7b17f6f20f0ad4c5da6350726b8b94680
Author: Bogdan Raducanu <[email protected]>
Date: 2017-06-28T12:55:02Z
fix by using TypeUtils.getInterpretedOrdering
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
