[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/21404 That would be helpful for us in the end. But, sorry for now. I'm currently not planning it open soon because the next release (Apache Spark 2.5 or 3.0) will next year. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user tooptoop4 commented on the issue: https://github.com/apache/spark/pull/21404 @dongjoon-hyun I was planning to do my own custom build by cherrypicking your PR if you had it available --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/21404 @tooptoop4 . Since this is a new feature, it's now targeting for Apache Spark 2.5 since `branch-2.4` is already cut. In addition, this will not be allowed for backporting `branch-2.4`. Is it urgent for you, @tooptoop4 ? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user tooptoop4 commented on the issue: https://github.com/apache/spark/pull/21404 bump --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/21404 Thank you for review, @tooptoop4 and @wangyum . I'm going to update this to the latest Hive 3.1.0. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user tooptoop4 commented on the issue: https://github.com/apache/spark/pull/21404 Also, can hive 3.1 be supported easily or are there some breaking changes? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user tooptoop4 commented on the issue: https://github.com/apache/spark/pull/21404 @dongjoon-hyun @wangyum @gatorsmile @HyukjinKwon Anything left on this? can it be merged to master? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21404 @dongjoon-hyun Thanks for your investigation! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21404 @wangyum I do not think we should deprecate the support of the previous versions of Hive metastore. Many Spark users are still using them. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/21404 I'm investigating timing issue here. Spark loads Hive Metastore class lazily. Here, Spark is trying to access Hive metastore tables like `DBS` before it's created. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21404 Probably separate ticket for Spark 3.0.0. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/21404 Can we remove the old hive support? such as 0.12, 0.13 and 0.14. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21404 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21404 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91008/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21404 **[Test build #91008 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91008/testReport)** for PR 21404 at commit [`079771d`](https://github.com/apache/spark/commit/079771d6df16fd27fdf3cbd9b22f091c52990151). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21404 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21404 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91003/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21404 **[Test build #91003 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91003/testReport)** for PR 21404 at commit [`079771d`](https://github.com/apache/spark/commit/079771d6df16fd27fdf3cbd9b22f091c52990151). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21404 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21404 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3485/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21404 **[Test build #91008 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91008/testReport)** for PR 21404 at commit [`079771d`](https://github.com/apache/spark/commit/079771d6df16fd27fdf3cbd9b22f091c52990151). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/21404 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/21404 The failures some from `ClassNotFoundException: org.apache.logging.log4j.util.Strings`. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21404 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/91001/ Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21404 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21404 **[Test build #91001 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91001/testReport)** for PR 21404 at commit [`1523b65`](https://github.com/apache/spark/commit/1523b6592725c3ca465ec0b6b63167cb4e6e3aec). * This patch **fails Spark unit tests**. * This patch merges cleanly. * This patch adds no public classes. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21404 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21404 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3482/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21404 **[Test build #91003 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91003/testReport)** for PR 21404 at commit [`079771d`](https://github.com/apache/spark/commit/079771d6df16fd27fdf3cbd9b22f091c52990151). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21404 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3481/ Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21404 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #21404: [SPARK-24360][SQL] Support Hive 3.0 metastore
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21404 **[Test build #91001 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/91001/testReport)** for PR 21404 at commit [`1523b65`](https://github.com/apache/spark/commit/1523b6592725c3ca465ec0b6b63167cb4e6e3aec). --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
