GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/13128
[SPARK-15337] [SPARK-15338] [SQL] Unable to Make Run-time Changes on
Hive-related Conf
#### What changes were proposed in this pull request?
Currently, we are facing two issues when using the Set Command.
1. When changing a Hive-related conf at runtime, we are not passing the
change to the underlying Hive metastore. For example, ```SET
hive.metastore.warehouse.dir=/x/y/z``` The following link contains the possible
conf: https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties
2. When changing the warehouse path conf `spark.sql.warehouse.dir`, we are
not changing the corresponding Hive metastore default warehouse path conf:
`hive.metastore.warehouse.dir`. Thus, this change does not take effect if the
underlying catalog is Hive metastore.
This PR is to fix the above two issues by using the native Hive SQL
interface, if necessary.
#### How was this patch tested?
Added two test cases to verify if the run-time configuration works in
either Hive metastore or In-Memory Catalog
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gatorsmile/spark hiveConfChange
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/13128.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #13128
----
commit 3c6ec38e4ee4f1451edfe52250855d6686d1b9a4
Author: gatorsmile <[email protected]>
Date: 2016-05-16T06:33:06Z
fix
commit d8d6ca32147174615fa51af97b294b70f919aec2
Author: gatorsmile <[email protected]>
Date: 2016-05-16T06:54:59Z
fix
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
