Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-157373552
Oh. I just got confused for a bit. Sorry.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-157341844
Please note that https://github.com/apache/spark/pull/9754 updated
unintentionally this to clean up at mater branch however, that is supposed to
be merged with
Github user liancheng commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-157343609
Hm, I don't quite get it... So this PR is only for master (targeting 1.7).
I don't think we need to backport this one to anywhere else.
---
If your project is set up
Github user liancheng commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-157389650
@marmbrus Did you mean the metadata stored in Parquet key-value user
defined metadata, or the schema metadata in `StructField`? For primitive
JSON/BSON fields, it's a
Github user marmbrus commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-157461363
> But it doesn't cover nested fields, e.g. an array field of JSON/BSON
elements.
That is an unfortunate limitation of our metadata, but it does seem like it
could
Github user asfgit closed the pull request at:
https://github.com/apache/spark/pull/9658
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user liancheng commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-157034946
Thanks! Merging to master.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user marmbrus commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-157106033
We've added support for reading these types as strings, but we can't round
trip data without losing the annotation which might be kind of confusing for
users. Perhaps
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156892687
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156892604
**[Test build #45963 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45963/consoleFull)**
for PR 9658 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156892689
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156878712
Thanks! I changed this.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156879224
**[Test build #45963 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45963/consoleFull)**
for PR 9658 at commit
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/9658#discussion_r44857287
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetIOSuite.scala
---
@@ -230,6 +230,31 @@ class ParquetIOSuite
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/9658#discussion_r44857285
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetIOSuite.scala
---
@@ -230,6 +230,31 @@ class ParquetIOSuite
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156383404
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156383408
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156383163
**[Test build #45843 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45843/consoleFull)**
for PR 9658 at commit
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156046292
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156046297
**[Test build #45724 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45724/consoleFull)**
for PR 9658 at commit
GitHub user HyukjinKwon opened a pull request:
https://github.com/apache/spark/pull/9658
[SPARK-11692][SQL] Support for Parquet logical types, JSON and BSON
(embedded types)
Parquet supports some JSON and BSON datatypes. They are represented as
binary for BSON and string (UTF-8)
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156041765
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156041721
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156045491
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156045498
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156048205
**[Test build #45726 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45726/consoleFull)**
for PR 9658 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156047310
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156047239
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156054561
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156054425
**[Test build #45724 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45724/consoleFull)**
for PR 9658 at commit
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156052665
cc @liancheng
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156054558
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156040151
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156291768
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156292727
**[Test build #45804 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45804/consoleFull)**
for PR 9658 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156096335
**[Test build #45732 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45732/consoleFull)**
for PR 9658 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156078356
**[Test build #45726 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45726/consoleFull)**
for PR 9658 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156078411
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156078409
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user liancheng commented on a diff in the pull request:
https://github.com/apache/spark/pull/9658#discussion_r44649314
--- Diff:
sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetIOSuite.scala
---
@@ -206,6 +206,29 @@ class ParquetIOSuite
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156094954
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156094936
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156093233
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156093209
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156094242
**[Test build #45731 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45731/consoleFull)**
for PR 9658 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156355368
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156355396
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156330974
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156330934
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156332394
**[Test build #45835 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45835/consoleFull)**
for PR 9658 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156345454
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156345451
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156345230
**[Test build #45835 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45835/consoleFull)**
for PR 9658 at commit
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156355260
All the builds pass all the tests at `ParquetIOSuite` and I do not think it
affects other modules such as ML.
I will retest this.
---
If your project is set up
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156355277
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user HyukjinKwon commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156320809
retest this please
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156356056
**[Test build #45843 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45843/consoleFull)**
for PR 9658 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156320422
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156320421
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156320377
**[Test build #45804 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45804/consoleFull)**
for PR 9658 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156321027
Merged build triggered.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156321043
Merged build started.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156321139
**[Test build #45827 has
started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45827/consoleFull)**
for PR 9658 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156329224
**[Test build #45827 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45827/consoleFull)**
for PR 9658 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156329270
Merged build finished. Test FAILed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156329272
Test FAILed.
Refer to this link for build results (access rights to CI server needed):
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156131583
**[Test build #45732 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45732/consoleFull)**
for PR 9658 at commit
Github user SparkQA commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156131986
**[Test build #45731 has
finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/45731/consoleFull)**
for PR 9658 at commit
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156132233
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156131796
Test PASSed.
Refer to this link for build results (access rights to CI server needed):
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156132232
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/9658#issuecomment-156131792
Merged build finished. Test PASSed.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your
72 matches
Mail list logo
