GitHub user maropu opened a pull request:
https://github.com/apache/spark/pull/21711
[SPARK-24681][SQL] Verify nested column names in Hive metastore
## What changes were proposed in this pull request?
This pr added code to check if nested column names do not include ',', ':',
and ';' because Hive metastore can't handle these characters in nested column
names;
ref:
https://github.com/apache/hive/blob/release-1.2.1/serde/src/java/org/apache/hadoop/hive/serde2/typeinfo/TypeInfoUtils.java#L239
## How was this patch tested?
Added tests in `SQLQuerySuite`.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/maropu/spark SPARK-24681
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21711.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21711
----
commit dbc300edb56b6e813c926b061e780378ee564778
Author: Takeshi Yamamuro <yamamuro@...>
Date: 2018-07-04T04:07:04Z
Fix
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
