wangyum commented on a change in pull request #25431: [SPARK-28711][DOCS]
Update migration guide to add note about Hive upgrade
URL: https://github.com/apache/spark/pull/25431#discussion_r313718805
##########
File path: docs/sql-migration-guide-upgrade.md
##########
@@ -23,6 +23,9 @@ license: |
{:toc}
## Upgrading From Spark SQL 2.4 to 3.0
+ - Since Spark 3.0, hive is upgraded to 2.3.x, so it is required to update
the Hive
Review comment:
There are two things here:
1. If you want to improve the performance of the Hive Metastore Server. The
correct way is to upgrade your Hive Metastore Server to latest version.
`SCHEMA_VERSION` should be updated by [Hive
itself](https://github.com/apache/hive/blob/c57a59611fa168ee38c6ee0ee60b1d6c4994f9f8/metastore/scripts/upgrade/mysql/upgrade-1.2.0-to-1.3.0.mysql.sql).
2. Upgrade built-in Hive to 2.3.x still can get benefits if you Hive
Metastore Server is 1.2.x, such as
[SPARK-12014](https://issues.apache.org/jira/browse/SPARK-12014),
[SPARK-27500](https://issues.apache.org/jira/browse/SPARK-27500) and
[SPARK-26321](https://issues.apache.org/jira/browse/SPARK-26321).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
