sandeep-katta commented on a change in pull request #25431: [SPARK-28711][DOCS]
Update migration guide to add note about Hive upgrade
URL: https://github.com/apache/spark/pull/25431#discussion_r313506465
##########
File path: docs/sql-migration-guide-upgrade.md
##########
@@ -23,6 +23,9 @@ license: |
{:toc}
## Upgrading From Spark SQL 2.4 to 3.0
+ - Since Spark 3.0, hive is upgraded to 2.3.x, so it is required to update
the Hive
Review comment:
Hive maintains the `SCHEMA_VERSION` in the `VERSION` table of the metastore
db(this database name will be configured by the user in the hive-site.xml),
this SCHEMA_VERSION should be updated to at least 2.3.0.
I taught it's better capture in the migration guide as in my production
environment thrift server failed to start after upgrade to spark 3.0. If the
users are aware of this then I can cancel this ticket
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
