[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70336/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #70336 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70336/testReport)** for PR 14365 at commit [`141cb1d`](https://github.com/apache/spark/commit/141cb1d5232a14d72f6411afdb1212cf7ef4de0a). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #70336 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70336/testReport)** for PR 14365 at commit [`141cb1d`](https://github.com/apache/spark/commit/141cb1d5232a14d72f6411afdb1212cf7ef4de0a). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14365 ping @cloud-fan @yhuai May you take a look? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14365 It looks good to me. Thank you for updating, @viirya ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69856/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #69856 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69856/consoleFull)** for PR 14365 at commit [`2bb8368`](https://github.com/apache/spark/commit/2bb836868dec18c5f214a2bef45664a22124885e). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #69856 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69856/consoleFull)** for PR 14365 at commit [`2bb8368`](https://github.com/apache/spark/commit/2bb836868dec18c5f214a2bef45664a22124885e). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14365 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69852/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14365 @cloud-fan @yhuai @dongjoon-hyun I've updated this as: * Assume metastore schema matches with physical Orc schema by column, disregarding column names. * Mapping required schema to columns in physical Orc schema. * If the length or data types of metastore schema and physical schema is not matched, throw an exception suggesting users to disable `spark.sql.hive.convertMetastoreOrc`. Please let me know what you think about this approach. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #69852 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69852/consoleFull)** for PR 14365 at commit [`2bb8368`](https://github.com/apache/spark/commit/2bb836868dec18c5f214a2bef45664a22124885e). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14365 We have two options. First one is to map metastore schema to physical Orc schema like this. But we don't infer physical schema of Orc file now. I will update this to have this mapping in OrcFileFormat. Another one is like #14282. But as we don't infer schema from Orc file now, we can't disable the conversion when the mismatch is detected. One possible is to throw exception in OrcFileFormat when detecting the mismatch before reading and show message to ask user to disable `spark.sql.hive.convertMetastoreOrc`. @cloud-fan @yhuai @dongjoon-hyun What do you think? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14365 @dongjoon-hyun yeah, I see. Because we directly use metastore schema of converted Orc table, when the physical schema in Orc file and metastore schema mismatch, this issue happens. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user dongjoon-hyun commented on the issue:
https://github.com/apache/spark/pull/14365
It seems to exist some cases like the following (on the current master).
On hive,
```sql
CREATE TABLE t1 (a string) PARTITIONED BY (b string) STORED AS ORC;
INSERT INTO TABLE t1 PARTITION (b='01') VALUES ('1');
```
On `spark-shell`,
```scala
scala> sql("select * from t1").show
+---+---+
| a| b|
+---+---+
| 1| 01|
+---+---+
scala> sql("set spark.sql.hive.convertMetastoreOrc=true").show
++-+
| key|value|
++-+
|spark.sql.hive.co...| true|
++-+
scala> sql("select * from t1").show
16/12/07 05:17:19 ERROR Executor: Exception in task 0.0 in stage 2.0 (TID 2)
java.lang.IllegalArgumentException: Field "a" does not exist.
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14365 As we replace schema inferring with metastore schema completely by #14690 for converted Hive tables, we may not have the chance to detect the mismatch between Orc file's physical schema and metastore schema. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/14365 Hi, @viirya , @cloud-fan , @yhuai . #14690 and the parent issue SPARK-17861 seems to be resolved? What about restarting this issue? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14365 @cloud-fan actually, this conversion was disabled because of this bug. btw, pr that @cloud-fan mentioned is https://github.com/apache/spark/pull/14690. I think it is better to hold this change before we finish https://github.com/apache/spark/pull/14690. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14365 I noticed that `spark.sql.hive.convertMetastoreOrc` is false by default, so this bug is not so critical. And we may stop inferring file schema when reading ORC tables, for performance reasons(#16980), then we don't have the chance to detect the mismatch and disable this feature. We may remove this feature entirely, or thinking harder to come up with a better fix. cc @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14365 ping @cloud-fan Can you have a decision about this? Are we going to have complex logic for this issue? Or just disable it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14365 @cloud-fan So do we have decision on this? A simpler approach to disable the conversion if the schema is inconsistent, or a complex one to work around this Hive bug? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63214/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #63214 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63214/consoleFull)** for PR 14365 at commit [`5cfdff1`](https://github.com/apache/spark/commit/5cfdff106a038fe1f1beead5ccf3138d168f45d5). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #63214 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63214/consoleFull)** for PR 14365 at commit [`5cfdff1`](https://github.com/apache/spark/commit/5cfdff106a038fe1f1beead5ccf3138d168f45d5). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14365 @cloud-fan I've submitted a PR #14282 previously that disables the conversion if the schema is inconsistent. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/14365 @rxin @yhuai , is it worth adding this complex logic to work around this hive bug? This feature(convert Metastore Orc tables to data source table) is not a major feature and the broken case seems a corner case. I think it's ok to disable this feature when we meet this hive bug, what do you think? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14365 cc @yhuai @liancheng @rxin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62993/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #62993 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62993/consoleFull)** for PR 14365 at commit [`0c17748`](https://github.com/apache/spark/commit/0c177484909e75c6a90555aa84e76ccede570df5). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #62993 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62993/consoleFull)** for PR 14365 at commit [`0c17748`](https://github.com/apache/spark/commit/0c177484909e75c6a90555aa84e76ccede570df5). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14365 cc @cloud-fan @yhuai @liancheng @rxin Please review this change. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62880/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #62880 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62880/consoleFull)** for PR 14365 at commit [`cc953a3`](https://github.com/apache/spark/commit/cc953a3075675ecc97cf5342c6e29d940b1dfe3e). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14365 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62875/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #62875 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62875/consoleFull)** for PR 14365 at commit [`f9fab59`](https://github.com/apache/spark/commit/f9fab596e60a138eb9fbc2f8436de7b8a8f76da2). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #62880 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62880/consoleFull)** for PR 14365 at commit [`cc953a3`](https://github.com/apache/spark/commit/cc953a3075675ecc97cf5342c6e29d940b1dfe3e). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #14365: [SPARK-16628][SQL] Translate file-based relation schema ...
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14365 **[Test build #62875 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62875/consoleFull)** for PR 14365 at commit [`f9fab59`](https://github.com/apache/spark/commit/f9fab596e60a138eb9fbc2f8436de7b8a8f76da2). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
