GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/14971
[SPARK-17410] [SPARK-17284] Move Hive-generated Stats Info to HiveClientImpl
### What changes were proposed in this pull request?
After we adding a new field `stats` into `CatalogTable`, we should not
expose Hive-specific Stats metadata to `MetastoreRelation`. It complicates all
the related codes. It also introduces a bug in `SHOW CREATE TABLE`. The
statistics-related table properties should be skipped by `SHOW CREATE TABLE`,
since it could be incorrect in the newly created table. See the Hive JIRA:
https://issues.apache.org/jira/browse/HIVE-13792
This PR is to handle Hive-specific Stats metadata in `HiveClientImpl`.
### How was this patch tested?
Added a few test cases.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gatorsmile/spark showCreateTableNew
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/14971.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #14971
----
commit 92474c5a142fb9db2c86549c8347f910fc01fcbd
Author: gatorsmile <[email protected]>
Date: 2016-08-28T22:28:15Z
remove stats-related props
commit ce8e8b89a5b61648daaa59578e2b6a99ec2f6d74
Author: gatorsmile <[email protected]>
Date: 2016-08-29T05:24:05Z
address comments
commit 9ce526b7729c4111292d6abb69bd81aec0ecf5de
Author: gatorsmile <[email protected]>
Date: 2016-09-06T00:25:56Z
Merge remote-tracking branch 'upstream/master' into showCreateTable
commit efd879dbda12e235d00d9b6bc4891a591832912b
Author: gatorsmile <[email protected]>
Date: 2016-09-06T07:07:12Z
move stats from metastorerelation to hiveclientimpl
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
