GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/15255
[SPARK-17680] [SQL] [TEST] Added a Testcase for Verifying Unicode Character
Support for Column Names and Comments
### What changes were proposed in this pull request?
When the version of the Hive metastore is higher than 0.12, Spark SQL
supports Unicode characters for column names when specified within
backticks(`). See the JIRA: https://issues.apache.org/jira/browse/HIVE-6013
Hive metastore supports Unicode characters for column names since 0.13
In Spark SQL, table comments, and view comments always allow Unicode
characters without backticks.
BTW, will submit a separate PR for database and table name validation
because we do not support Unicode characters in these two cases.
### How was this patch tested?
N/A
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gatorsmile/spark unicodeSupport
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/15255.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #15255
----
commit 41d3bae9c3730b64a54c17098e203a78620b2032
Author: gatorsmile <[email protected]>
Date: 2016-09-27T04:20:25Z
added
commit 741d59c2565f70404409cc4a8afcf002148c3d74
Author: gatorsmile <[email protected]>
Date: 2016-09-27T05:06:18Z
improved
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
