GitHub user liufengdb opened a pull request:
https://github.com/apache/spark/pull/20681
[SPARK-23518][SQL] Completely remove metastore access if the query is not
using tables
## What changes were proposed in this pull request?
https://github.com/apache/spark/pull/18944 added one patch, which allowed a
spark session to be created when the hive metastore server is down. However, it
did not allow running any commands with the spark session. So the users could
not read / write data frames, when the hive metastore server is down.
## How was this patch tested?
Added some unit tests to read and write data frames based on the original
HiveMetastoreLazyInitializationSuite.
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/liufengdb/spark completely-lazy
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20681.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20681
----
commit b447beab9e43595d61ef0f51c91a09fd2f72a87e
Author: Feng Liu <fengliu@...>
Date: 2018-02-26T07:08:47Z
lazy
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
