[
https://issues.apache.org/jira/browse/SPARK-30643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17023726#comment-17023726
]
Igor Dvorzhak commented on SPARK-30643:
---------------------------------------
Hi, [~dongjoon]. Thank you for fixing up this JIRA.
I think that majority of reasons that went into support of embedding Hive 2.3
will apply to support of embedding Hive 3.
As a user I would want to have as close behavior as possible between Spark SQL
and Hive queries in the same installation where I use both Spark and Hive. But
if I chose to run Hive 3 and Spark with embedded Hive 2.3, then SparkSQL and
Hive queries behavior could differ in some cases.
Personally, I'm interested in performance and correctness improvements that
were made to Hive Server, Driver and Metastore client in Hive 3.
AWS EMR 6.0 (currently in beta) uses Hive 3, I would expect that other vendors
will follow suit soon too.
Will follow up in dev list too, thanks!
> Add support for embedding Hive 3
> --------------------------------
>
> Key: SPARK-30643
> URL: https://issues.apache.org/jira/browse/SPARK-30643
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Igor Dvorzhak
> Priority: Major
>
> Currently Spark can be compiled only against Hive 1.2.1 and Hive 2.3,
> compilation fails against Hive 3.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
