[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-14 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17178 thanks! merged to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17178 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74559/ Test PASSed. ---

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17178 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17178 **[Test build #74559 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74559/testReport)** for PR 17178 at commit [`8ec7cd0`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17178 **[Test build #74559 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74559/testReport)** for PR 17178 at commit [`8ec7cd0`](https://github.com/apache/spark/commit/8e

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-14 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17178 that's ridiculous ... dot in names is the norm https://stat.ethz.ch/R-manual/R-devel/library/utils/html/read.table.html anyway --- If your project is set up for it, you can reply to th

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17178 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17178 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74507/ Test PASSed. ---

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17178 **[Test build #74507 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74507/testReport)** for PR 17178 at commit [`d01f952`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17178 **[Test build #74507 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74507/testReport)** for PR 17178 at commit [`d01f952`](https://github.com/apache/spark/commit/d0

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-14 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17178 Let me go for `as.json.object`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-13 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17178 seems like `object` is the right term in JSON lango - how about `as.json.object`? otherwise `as.json.array` (the opposite) or `as.json.object.array` might be good option --- If your project is

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17178 How about `as.struct`? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17178 > array might be a bit vague - does that require the column value to be a JSON array, or just multiple JSON object spanning multiple line? Yup, it requires that input is a JSON array (mu

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-12 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17178 Thank you @felixcheung. Let me try to handle the comments soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-12 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17178 a couple of thoughts - a default FALSE parameter might be less intuitive - do you think we could come up with a default TRUE parameter (ok, `single`?) - if it's asX, typically it would be

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17178 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17178 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74326/ Test PASSed. ---

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17178 **[Test build #74326 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74326/testReport)** for PR 17178 at commit [`5c2450d`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-10 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17178 @felixcheung, I tried to add an optional parameter, `asArray`. Could you take a look and see if it makes sense? --- If your project is set up for it, you can reply to this email and have your r

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17178 **[Test build #74326 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74326/testReport)** for PR 17178 at commit [`5c2450d`](https://github.com/apache/spark/commit/5c

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17178 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17178 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/73997/ Test PASSed. ---

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17178 **[Test build #73997 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73997/testReport)** for PR 17178 at commit [`10feb9d`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17178 **[Test build #73997 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/73997/testReport)** for PR 17178 at commit [`10feb9d`](https://github.com/apache/spark/commit/10

[GitHub] spark issue #17178: [SPARK-19828][R] Support array type in from_json in R

2017-03-06 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17178 @felixcheung, this is a bit different with what we talked but I opened this because I thought you might like this more. This takes the type string given to `structField` now. If you are worried