gatorsmile commented on issue #27815: [SPARK-31088][SQL] Add back HiveContext and createExternalTable URL: https://github.com/apache/spark/pull/27815#issuecomment-603650408 There are two major reasons why I think we should keep HiveContext: - SQLContext will not be removed in the near future, because it is part of DSV1 APIs. HiveContext is just the corresponding parts with Hive metastore support. - SQLContext/HiveContext is being used as the function parameter in many internal/public libraries. Replace it by SparkSession is not straightforward. It requires massive updates when end users upgrade Spark from 2.x to 3.x. - SQLContext/HiveContext is being documented in various tutorials and books.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
