[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-19 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/18676 Thanks! Merging to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-19 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/18676 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18676 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18676 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79730/ Test PASSed. ---

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18676 **[Test build #79730 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79730/testReport)** for PR 18676 at commit

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18676 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79721/ Test PASSed. ---

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18676 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18676 **[Test build #79721 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79721/testReport)** for PR 18676 at commit

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18676 **[Test build #79730 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79730/testReport)** for PR 18676 at commit

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18676 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18676 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79724/ Test FAILed. ---

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18676 **[Test build #79724 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79724/testReport)** for PR 18676 at commit

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18676 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18676 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79723/ Test FAILed. ---

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18676 **[Test build #79723 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79723/testReport)** for PR 18676 at commit

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18676 **[Test build #79724 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79724/testReport)** for PR 18676 at commit

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18676 **[Test build #79723 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79723/testReport)** for PR 18676 at commit

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/18676 One thing that worries me is the fact that we're paying the price of inferring partitions and reading all files from the log twice. I tried re-using the `metadataLog` instance in the copy of the new

[GitHub] spark issue #18676: [SPARK-21463] Allow userSpecifiedSchema to override part...

2017-07-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18676 **[Test build #79721 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79721/testReport)** for PR 18676 at commit