[
https://issues.apache.org/jira/browse/HIVE-21639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16822802#comment-16822802
]
Hyukjin Kwon commented on HIVE-21639:
-------------------------------------
Hi [~alangates] and [~owen.omalley].
To share the context, this is about HIVE-16391 and SPARK-20202. Previously, if
I didn't miss anything, it was decided to make another Hive release 1.2.x
before.
After that, I, [~yumwang], and Spark community had the discussion about it. In
particular, I and [~yumwang] are trying to push it forward in order to upgrade
Hive within Apache Spark (see this and [the mailing list
discussion|http://apache-spark-developers-list.1001551.n3.nabble.com/DISCUSS-Upgrade-built-in-Hive-to-2-3-4-td26153.html#a26300]),
rather than Hive side to publish 1.2.x with Spark side's fork. We are
currently putting a lot of efforts at SPARK-23710 to resolve all SPARK-23710,
HIVE-16391 and SPARK-20202.
To get to the point, this issue blocks Spark community to use Hive 2.3.4
officially. Spark targets to upgrade Hive within Spark 3.0. If this issue isn't
resolved, (I think) Apache Spark will end up with using Hive fork and having no
choice then asking Hive to release 1.2.x as of HIVE-16391, which in my humble
opinion isn't the best way for both Hive and Spark communities.
Would you guys mind merging this into branch-2.3 and releasing Hive 2.3.5 so
that Apache Spark side upgrade Hive and gets rid of its fork?
> Spark test failed since HIVE-10632
> ----------------------------------
>
> Key: HIVE-21639
> URL: https://issues.apache.org/jira/browse/HIVE-21639
> Project: Hive
> Issue Type: Bug
> Reporter: Yuming Wang
> Assignee: Yuming Wang
> Priority: Major
> Attachments: HIVE-21639.branch-2.patch
>
>
> We hint the following exception when [upgrading Spark‘s built-in Hive to
> 2.3.4|https://issues.apache.org/jira/browse/SPARK-23710]:
> {noformat}
> ..
> [info] Cause: java.sql.SQLException: Failed to start database 'metastore_db'
> with class loader
> org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@2439ab23, see
> the next exception for details.
> [info] at
> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
> [info] at
> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
> [info] at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
> [info] at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown
> Source)
> [info] at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source)
> [info] at org.apache.derby.jdbc.InternalDriver$1.run(Unknown Source)
> ...
> {noformat}
> This issue Introduced by HIVE-10632 and fixed by HIVE-17561, I'd like to
> backport part of HIVE-17561 to fix this issue for branch-2.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
