[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-14 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/13623 LGTM. Merging to master and branch 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13623 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60497/ Test PASSed. ---

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13623 **[Test build #60497 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60497/consoleFull)** for PR 13623 at commit [`b345d56`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13623 **[Test build #60497 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60497/consoleFull)** for PR 13623 at commit [`b345d56`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60430/ Test PASSed. ---

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13623 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13623 **[Test build #60430 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60430/consoleFull)** for PR 13623 at commit [`ee438e4`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-13 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13623 @rxin Thanks. Consolidated all the underscore- and dot-files filtering logic. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If yo

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13623 **[Test build #60430 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60430/consoleFull)** for PR 13623 at commit [`ee438e4`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-12 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13623 In this file PartitioningAwareFileCatalog.scala, we have multiple places that we filter out files that start with underscore. Should we also filter dot in those places? --- If your project is set up

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-12 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/13623 Looks good! +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-12 Thread ssimeonov
Github user ssimeonov commented on the issue: https://github.com/apache/spark/pull/13623 👍 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60371/ Test PASSed. ---

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13623 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13623 **[Test build #60371 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60371/consoleFull)** for PR 13623 at commit [`91faf01`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13623 **[Test build #60371 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60371/consoleFull)** for PR 13623 at commit [`91faf01`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13623 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/60360/ Test PASSed. ---

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13623 **[Test build #60360 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60360/consoleFull)** for PR 13623 at commit [`5015fa0`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13623 **[Test build #60360 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/60360/consoleFull)** for PR 13623 at commit [`5015fa0`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #13623: [SPARK-15895][SQL] Filters out metadata files while doin...

2016-06-12 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13623 @yhuai Unlike what we discussed before, we can't filter out metadata files [here][1]. Otherwise, Parquet read path may also skip all Parquet summary files, which isn't expected behavior.