GitHub user MaxGekk opened a pull request:
https://github.com/apache/spark/pull/21089
[SPARK-24004] Test of from_json for non-root MapType
## What changes were proposed in this pull request?
New test checks that from_json is able to parse json contains MapType as a
value type of struct fields. The test required adding of the equals and
hashCode methods to ArrayBasedMapData to compare returned result to expected
value.
## How was this patch tested?
Added comparison tests for ArrayBasedMapData and a test for from_json.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/MaxGekk/spark-1 from_json-map-tests
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21089.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21089
----
commit d91d93936ce1c12765dffdbf2fe773585dd39eae
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-04-17T18:15:44Z
Added a test for checking from_json: json -> struct of map
commit 428c6ba93202bf3235667794f9f8055c432733e1
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-04-17T18:16:54Z
Added a test for comparison of ArrayBasedMapData
commit 58d1f7e41883b5e8924eca83bcf72deedadaf0ef
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-04-17T19:01:00Z
Implemented the equals and hashCode methods of ArrayBasedMapData
commit 4391b0a94e7ddbf53043e6723b7e6e63655f5759
Author: Maxim Gekk <maxim.gekk@...>
Date: 2018-04-17T19:21:49Z
Improving test title
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
