[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-06 Thread rdblue
Github user rdblue commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118934295 @liancheng, thanks! I'll make some time to look at it this week. Most likely Wednesday. --- If your project is set up for it, you can reply to this email and have your r

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-06 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118932998 @rdblue As usual, you're always welcome to help reviewing this :-) As you suggested, the main part of this PR (`CatalystRowConverter`) takes parquet-avro as the refere

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-06 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/7231#discussion_r33958848 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/CatalystRowConverter.scala --- @@ -0,0 +1,421 @@ +/* + * Licensed to the Apache Soft

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118744074 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118743989 [Test build #36557 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36557/console) for PR 7231 at commit [`8be4723`](https://github.

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118710803 [Test build #36557 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36557/consoleFull) for PR 7231 at commit [`8be4723`](https://gith

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118710134 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118710172 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118698676 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118698670 [Test build #36554 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36554/console) for PR 7231 at commit [`9b87903`](https://github.

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118695116 [Test build #36554 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36554/consoleFull) for PR 7231 at commit [`9b87903`](https://gith

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118694192 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118694202 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118693905 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118693904 [Test build #36553 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36553/console) for PR 7231 at commit [`3581497`](https://github.

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/7231#discussion_r33902735 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/parquet/CatalystRowConverter.scala --- @@ -0,0 +1,421 @@ +/* + * Licensed to the Apache Soft

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118693829 [Test build #36553 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/36553/consoleFull) for PR 7231 at commit [`3581497`](https://gith

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118692829 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not h

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7231#issuecomment-118692837 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6776] [SPARK-8811] [SQL] Refactors Parq...

2015-07-05 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/7231 [SPARK-6776] [SPARK-8811] [SQL] Refactors Parquet read path for interoperability and backwards-compatibility This PR ensures interoperability and backwards-compatibility for the read path. A new