GitHub user cloud-fan opened a pull request:
https://github.com/apache/spark/pull/15024
[SPARK-17470][SQL] unify path for data source table and locationUri for
hive serde table
## What changes were proposed in this pull request?
Due to a limitation of hive metastore(table location must be directory
path, not file path), we always store `path` for data source table in storage
properties, instead of the `locationUri` field. However, we should not expose
this difference to `CatalogTable` level, but just treat it as a hack in
`HiveExternalCatalog`, like we store table schema of data source table in table
properties.
This PR unifies `path` and `locationUri` outside of `HiveExternalCatalog`,
both data source table and hive serde table should use the `locationUri` field.
This PR also unifies the way we handle default table location for managed
table. Previously, the default table location of hive serde managed table is
set by external catalog, but the one of data source table is set by command.
After this PR, we follow the hive way and the default table location is always
set by external catalog.
## How was this patch tested?
existing tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/cloud-fan/spark path
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/15024.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #15024
----
commit 978c94cf25c4c6c19a693d7028573c43f160ee80
Author: Wenchen Fan <wenc...@databricks.com>
Date: 2016-09-09T13:08:38Z
unify path for data source table and locationUri for hive serde table
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
