GitHub user bogdanrdc opened a pull request:
https://github.com/apache/spark/pull/20547
[SPARK-23316][SQL] AnalysisException after max iteration reached for IN
query
## What changes were proposed in this pull request?
Added flag ignoreNullability to DataType.equalsStructurally.
The previous semantic is for ignoreNullability=false.
When ignoreNullability=true equalsStructurally ignores nullability of
contained types (map key types, value types, array element types, structure
field types).
In.checkInputTypes calls equalsStructurally to check if the children types
match. They should match regardless of nullability (which is just a hint), so
it is now called with ignoreNullability=true.
## How was this patch tested?
New test in SubquerySuite.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/bogdanrdc/spark SPARK-23316
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20547.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20547
----
commit 03a4281751e02acd2b97ceff6cf8e1621e83eb93
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-04-20T10:59:49Z
fix + test
commit 72cf1d117890abe45aa30c6b91a7e2c527fc4969
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-04-20T11:01:40Z
reverted mistake commit
commit 2c96a8d65059db3b808e05241b870ccd17937095
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-05-12T15:24:57Z
erge remote-tracking branch 'upstream/master'
commit fa11b0b97b38bb98b599a8edf1d43e01b067a926
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-05-23T11:28:34Z
Merge remote-tracking branch 'upstream/master'
commit 21ad3aa4468b58aa4e552e2922e1bceda61097f7
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-05-23T11:28:57Z
Merge remote-tracking branch 'upstream/master'
commit 7f78cce9d6869371e2e28ce5d9fc4766d7dbc3de
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-06-06T11:19:35Z
Merge remote-tracking branch 'upstream/master'
commit eea2e5d466558aa3f2f6232024e8150dc246ba8a
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-06-07T10:35:37Z
Merge remote-tracking branch 'upstream/master'
commit b30788eac9df5e76863393826230481e23e52550
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-06-16T10:49:48Z
Merge remote-tracking branch 'upstream/master'
commit 38a0347e3079a3e56d70b77f5e25994497eabe41
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-06-27T10:33:10Z
Merge remote-tracking branch 'upstream/master'
commit 1057abe6262353093ccf9b75ed24ed54fdfc0095
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-06-28T12:35:12Z
Merge remote-tracking branch 'upstream/master'
commit 3f7bf43fab830c7cc6473b654ca290b23a9886be
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-07-07T11:08:05Z
Merge remote-tracking branch 'upstream/master'
commit 0a51b0f8640236da4054a25ca50bb8d19ba73b70
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-07-09T11:08:41Z
Merge remote-tracking branch 'upstream/master'
commit 3d11dca76380c7c53710141114aa768b1477b893
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-07-10T10:18:46Z
Merge remote-tracking branch 'upstream/master'
commit 015c84b6beb29c0b275b01f7774a2b7d8aa8d180
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-07-12T10:21:48Z
Merge remote-tracking branch 'upstream/master'
commit 597ddf2265149427f796eed1a43539b13e1516d9
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-08-03T12:45:36Z
Merge remote-tracking branch 'upstream/master'
commit 38549ba22681ba6622c4f1cd9c1b97592c5a34a5
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-08-04T09:17:09Z
Merge remote-tracking branch 'upstream/master'
commit 89b86c0d1e4616eae2902da79be308e0573ab5e3
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-09-10T19:23:22Z
Merge remote-tracking branch 'upstream/master'
commit edd1fbf107501bc9a0bdbf4f712577b9fe1fd3f6
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-10-30T14:18:09Z
Merge remote-tracking branch 'upstream/master'
commit 6ead465cb00fc36869d152693a4cd1318fa005b9
Author: Bogdan Raducanu <bogdan@...>
Date: 2017-12-21T15:17:45Z
Merge remote-tracking branch 'upstream/master'
commit d83a3adfba5d790270214887f615ab95ba50a2f9
Author: Bogdan Raducanu <bogdan@...>
Date: 2018-01-10T11:53:31Z
Merge remote-tracking branch 'upstream/master'
commit 4b79fd683102137401ed4e77ee351439c0d254b5
Author: Bogdan Raducanu <bogdan@...>
Date: 2018-01-11T04:01:12Z
Merge remote-tracking branch 'upstream/master'
commit ffa5debdd3b6a7e0bd70d01e640f048883b23440
Author: Bogdan Raducanu <bogdan@...>
Date: 2018-01-18T12:44:12Z
Merge remote-tracking branch 'upstream/master'
commit aec35c98a4ea0db2cee52785e51130243cdc0b61
Author: Bogdan Raducanu <bogdan@...>
Date: 2018-01-24T17:23:37Z
Merge remote-tracking branch 'upstream/master'
commit 87d8649777d7481beca7a04f195e04bab5b059a0
Author: Bogdan Raducanu <bogdan@...>
Date: 2018-02-02T11:02:31Z
Merge remote-tracking branch 'upstream/master'
commit 4d6b42a3a7cbc7254f7fa159a7d04b898c8b65e6
Author: Bogdan Raducanu <bogdan@...>
Date: 2018-02-08T14:57:57Z
fix and test
commit 79e2593b90ce33788e012ee28fc4cbd3bf6e4264
Author: Bogdan Raducanu <bogdan@...>
Date: 2018-02-08T14:59:13Z
Merge remote-tracking branch 'upstream/master' into SPARK-23316
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
