[GitHub] spark issue #21472: [SPARK-24445][SQL] Schema in json format for from_json i...

2018-06-15 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21472 It's not equal but I mean it's preferred. Does nullability matter in your case and does our Jackson parser properly handle the nullability? ---

[GitHub] spark issue #21472: [SPARK-24445][SQL] Schema in json format for from_json i...

2018-06-15 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/21472 @HyukjinKwon @maropu I am trying to use DDL instead of JSON for schema specification. Cannot find how to specify `nullable`, for example: - `valueContainsNull` for `MapType` - `nullable` for

[GitHub] spark issue #21472: [SPARK-24445][SQL] Schema in json format for from_json i...

2018-06-15 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21472 +1 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21472: [SPARK-24445][SQL] Schema in json format for from_json i...

2018-06-15 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21472 Let's leave this closed for now. I got that there can be a usecase by this now, but let's wait and see if there could be more compelling cases in the future. Currently, I am not positive on

[GitHub] spark issue #21472: [SPARK-24445][SQL] Schema in json format for from_json i...

2018-06-15 Thread MaxGekk
Github user MaxGekk commented on the issue: https://github.com/apache/spark/pull/21472 @HyukjinKwon Should I close this, or there is a chance that the PR will be merged to keep SQL consistence with Scala, Python and etc.? ---

[GitHub] spark issue #21472: [SPARK-24445][SQL] Schema in json format for from_json i...

2018-06-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21472 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21472: [SPARK-24445][SQL] Schema in json format for from_json i...

2018-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21472 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91361/ Test PASSed. ---

[GitHub] spark issue #21472: [SPARK-24445][SQL] Schema in json format for from_json i...

2018-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21472 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21472: [SPARK-24445][SQL] Schema in json format for from_json i...

2018-05-31 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21472 **[Test build #91361 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91361/testReport)** for PR 21472 at commit

[GitHub] spark issue #21472: [SPARK-24445][SQL] Schema in json format for from_json i...

2018-05-31 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21472 **[Test build #91361 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91361/testReport)** for PR 21472 at commit

[GitHub] spark issue #21472: [SPARK-24445][SQL] Schema in json format for from_json i...

2018-05-31 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21472 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional