[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14809 thanks for the review, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14809 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65002/ Test PASSed. ---

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14809 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14809 **[Test build #65002 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65002/consoleFull)** for PR 14809 at commit

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14809 **[Test build #65002 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65002/consoleFull)** for PR 14809 at commit

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14809 LGTM pending test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14809 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14809 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14809 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64988/ Test FAILed. ---

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14809 **[Test build #64988 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64988/consoleFull)** for PR 14809 at commit

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14809 **[Test build #64988 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64988/consoleFull)** for PR 14809 at commit

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14809 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14809 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64981/ Test FAILed. ---

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14809 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14809 **[Test build #64981 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64981/consoleFull)** for PR 14809 at commit

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14809 **[Test build #64981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64981/consoleFull)** for PR 14809 at commit

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14809 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14809 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14809 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64974/ Test FAILed. ---

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14809 **[Test build #64974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64974/consoleFull)** for PR 14809 at commit

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-09-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14809 **[Test build #64974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64974/consoleFull)** for PR 14809 at commit

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-08-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14809 Yeah, that is a bug. We did not get an exception when we read it, but we can get the error when trying to write it. The error message is confusing ``` Can only write data to relations

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-08-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14809 ah i see, btw in your example when will we throw exception? when we read it? a file-based external table without path is invalid. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-08-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14809 If we do not specify the schema, it will behave like what you said. For example, ```Scala sparkSession.catalog.createExternalTable( "createdParquetTable",

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-08-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14809 @gatorsmile can you explain more about this example? I think we will throw exception in `CreateDataSourceTableCommand` when we create a `DataSource` and call its `resolveRelation`. --- If your

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-08-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14809 Condition 2 is not always true when condition 1 is `true`. I found an exception. ```Scala val schema = StructType(StructField("b", StringType, true) :: Nil)

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-08-25 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/14809 https://github.com/apache/spark/pull/13060 This change is based on another PR. If users specify the location in `CREATE TABLE`, we always set the table type to `EXTERNAL`. --- If your project

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14809 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64425/ Test PASSed. ---

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14809 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14809 **[Test build #64425 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64425/consoleFull)** for PR 14809 at commit

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14809 **[Test build #64425 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64425/consoleFull)** for PR 14809 at commit

[GitHub] spark issue #14809: [SPARK-17238][SQL] simplify the logic for converting dat...

2016-08-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14809 cc @yhuai @gatorsmile @liancheng @clockfly --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this