GitHub user ueshin opened a pull request:
https://github.com/apache/spark/pull/23176
[SPARK-26211][SQL] Fix InSet for binary, and struct and array with null.
## What changes were proposed in this pull request?
Currently `InSet` doesn't work properly for binary type, or struct and
array type with null value in the set.
Because, as for binary type, the `HashSet` doesn't work properly for
`Array[Byte]`, and as for struct and array type with null value in the set, the
`ordering` will throw a `NPE`.
## How was this patch tested?
Added a few tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ueshin/apache-spark issues/SPARK-26211/inset
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/23176.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #23176
----
commit 277c48f63b9d36028b5dfbb3c850418713197cc4
Author: Takuya UESHIN <ueshin@...>
Date: 2018-11-29T06:47:29Z
Fix InSet for binary, and struct and array with null.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
