GitHub user dilipbiswal opened a pull request:
https://github.com/apache/spark/pull/19215
[MINOR][SQL] Only populate type metadata for required types such as
CHAR/VARCHAR.
## What changes were proposed in this pull request?
When reading column descriptions from hive catalog, we currently populate
the metadata for all types to record the raw hive type string. In terms of
processing , we need this additional metadata information for CHAR/VARCHAR
types or complex type containing the CHAR/VARCHAR types.
Its a minor cleanup. I haven't created a JIRA for it.
## How was this patch tested?
Test added in HiveMetastoreCatalogSuite
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dilipbiswal/spark column_metadata
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19215.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19215
----
commit d29c6ff158ad2da52c95d1073726f6f5763b3187
Author: Dilip Biswal <[email protected]>
Date: 2017-08-05T00:08:09Z
Only populate type metadata for required types such as CHAR/VARCHAR.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
