[jira] [Commented] (HIVE-9456) Make Hive support unicode with MSSQL as Metastore backend
[ https://issues.apache.org/jira/browse/HIVE-9456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14534092#comment-14534092 ] Lefty Leverenz commented on HIVE-9456: -- Does this need documentation? Make Hive support unicode with MSSQL as Metastore backend - Key: HIVE-9456 URL: https://issues.apache.org/jira/browse/HIVE-9456 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.14.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Fix For: 1.2.0 Attachments: HIVE-9456.1.patch, HIVE-9456.2.patch, HIVE-9456.3.patch, HIVE-9456.branch-1.2.patch There are significant issues when Hive uses MSSQL as metastore backend to support unicode, since MSSQL handles varchar and nvarchar datatypes differently. Hive 0.14 metastore mssql script DDL was using varchar as datatype, which can't handle multi-bytes/unicode characters, e.g., Chinese chars. This JIRA is going to track implementation of unicode support in that case. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-9456) Make Hive support unicode with MSSQL as Metastore backend
[ https://issues.apache.org/jira/browse/HIVE-9456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14530263#comment-14530263 ] Sushanth Sowmyan commented on HIVE-9456: Precommit tests skipped this saying that attachment id 12729762 had also already been tested. As I prepared to upload a .3.patch identical to the .2.patch, I got to thinking - there's no point in the precommit tests running on this patch - this patch affects only mssql, which the precommit tests do not use. [~thejas], what do you think? Should we go ahead and submit this as-is? Make Hive support unicode with MSSQL as Metastore backend - Key: HIVE-9456 URL: https://issues.apache.org/jira/browse/HIVE-9456 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.14.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-9456.1.patch, HIVE-9456.2.patch, HIVE-9456.branch-1.2.patch There are significant issues when Hive uses MSSQL as metastore backend to support unicode, since MSSQL handles varchar and nvarchar datatypes differently. Hive 0.14 metastore mssql script DDL was using varchar as datatype, which can't handle multi-bytes/unicode characters, e.g., Chinese chars. This JIRA is going to track implementation of unicode support in that case. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-9456) Make Hive support unicode with MSSQL as Metastore backend
[ https://issues.apache.org/jira/browse/HIVE-9456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531083#comment-14531083 ] Sushanth Sowmyan commented on HIVE-9456: Thanks, will do. Make Hive support unicode with MSSQL as Metastore backend - Key: HIVE-9456 URL: https://issues.apache.org/jira/browse/HIVE-9456 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.14.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-9456.1.patch, HIVE-9456.2.patch, HIVE-9456.3.patch, HIVE-9456.branch-1.2.patch There are significant issues when Hive uses MSSQL as metastore backend to support unicode, since MSSQL handles varchar and nvarchar datatypes differently. Hive 0.14 metastore mssql script DDL was using varchar as datatype, which can't handle multi-bytes/unicode characters, e.g., Chinese chars. This JIRA is going to track implementation of unicode support in that case. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-9456) Make Hive support unicode with MSSQL as Metastore backend
[ https://issues.apache.org/jira/browse/HIVE-9456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531077#comment-14531077 ] Thejas M Nair commented on HIVE-9456: - Please go ahead and commit this. Make Hive support unicode with MSSQL as Metastore backend - Key: HIVE-9456 URL: https://issues.apache.org/jira/browse/HIVE-9456 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.14.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-9456.1.patch, HIVE-9456.2.patch, HIVE-9456.3.patch, HIVE-9456.branch-1.2.patch There are significant issues when Hive uses MSSQL as metastore backend to support unicode, since MSSQL handles varchar and nvarchar datatypes differently. Hive 0.14 metastore mssql script DDL was using varchar as datatype, which can't handle multi-bytes/unicode characters, e.g., Chinese chars. This JIRA is going to track implementation of unicode support in that case. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-9456) Make Hive support unicode with MSSQL as Metastore backend
[
https://issues.apache.org/jira/browse/HIVE-9456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14530919#comment-14530919
]
Hive QA commented on HIVE-9456:
---
{color:red}Overall{color}: -1 no tests executed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12730875/HIVE-9456.3.patch
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-METASTORE-Test/44/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-METASTORE-Test/44/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-METASTORE-Test-44/
This message is automatically generated.
ATTACHMENT ID: 12730875 - PreCommit-HIVE-METASTORE-Test
Make Hive support unicode with MSSQL as Metastore backend
-
Key: HIVE-9456
URL: https://issues.apache.org/jira/browse/HIVE-9456
Project: Hive
Issue Type: Bug
Components: Metastore
Affects Versions: 0.14.0
Reporter: Xiaobing Zhou
Assignee: Xiaobing Zhou
Attachments: HIVE-9456.1.patch, HIVE-9456.2.patch, HIVE-9456.3.patch,
HIVE-9456.branch-1.2.patch
There are significant issues when Hive uses MSSQL as metastore backend to
support unicode, since MSSQL handles varchar and nvarchar datatypes
differently. Hive 0.14 metastore mssql script DDL was using varchar as
datatype, which can't handle multi-bytes/unicode characters, e.g., Chinese
chars. This JIRA is going to track implementation of unicode support in that
case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-9456) Make Hive support unicode with MSSQL as Metastore backend
[
https://issues.apache.org/jira/browse/HIVE-9456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528029#comment-14528029
]
Sushanth Sowmyan commented on HIVE-9456:
The precommit tests failed because it took the branch-1.2 attachment as the
latest patch to test:
{noformat}
+ grep -q 'ATTACHMENT ID: 12729763' /tmp/tmp.O03e6AgB80
+ shopt -s nocasematch
++ basename /jira/secure/attachment/12729763/HIVE-9456.branch-1.2.patch
+ PATCH_NAME=HIVE-9456.branch-1.2.patch
+ [[ HIVE-9456.branch-1.2.patch =~
^HIVE-[0-9]+(\.[0-9]+)?(-[a-z0-9-]+)?\.(patch|patch.txt)$ ]]
+ [[ HIVE-9456.branch-1.2.patch =~
^(HIVE-[0-9]+\.)?D[0-9]+(\.[0-9]+)?\.(patch|patch.txt)$ ]]
+ fail 'Patch HIVE-9456.branch-1.2.patch does not appear to be a patch'
+ echo 'Patch HIVE-9456.branch-1.2.patch does not appear to be a patch'
Patch HIVE-9456.branch-1.2.patch does not appear to be a patch
+ exit 1
+ rm -f /tmp/tmp.O03e6AgB80
Build step 'Execute shell' marked build as failure
Archiving artifacts
Recording test results
{noformat}
Will attempt to resubmit, with the appropriate attachment id 12729762.
Make Hive support unicode with MSSQL as Metastore backend
-
Key: HIVE-9456
URL: https://issues.apache.org/jira/browse/HIVE-9456
Project: Hive
Issue Type: Bug
Components: Metastore
Affects Versions: 0.14.0
Reporter: Xiaobing Zhou
Assignee: Xiaobing Zhou
Attachments: HIVE-9456.1.patch, HIVE-9456.2.patch,
HIVE-9456.branch-1.2.patch
There are significant issues when Hive uses MSSQL as metastore backend to
support unicode, since MSSQL handles varchar and nvarchar datatypes
differently. Hive 0.14 metastore mssql script DDL was using varchar as
datatype, which can't handle multi-bytes/unicode characters, e.g., Chinese
chars. This JIRA is going to track implementation of unicode support in that
case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HIVE-9456) Make Hive support unicode with MSSQL as Metastore backend
[ https://issues.apache.org/jira/browse/HIVE-9456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14527268#comment-14527268 ] Sushanth Sowmyan commented on HIVE-9456: Looks like we lost a bunch of queued precommit tests over the weekend. Have resubmitted this. Make Hive support unicode with MSSQL as Metastore backend - Key: HIVE-9456 URL: https://issues.apache.org/jira/browse/HIVE-9456 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.14.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-9456.1.patch, HIVE-9456.2.patch, HIVE-9456.branch-1.2.patch There are significant issues when Hive uses MSSQL as metastore backend to support unicode, since MSSQL handles varchar and nvarchar datatypes differently. Hive 0.14 metastore mssql script DDL was using varchar as datatype, which can't handle multi-bytes/unicode characters, e.g., Chinese chars. This JIRA is going to track implementation of unicode support in that case. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HIVE-9456) Make Hive support unicode with MSSQL as Metastore backend
[ https://issues.apache.org/jira/browse/HIVE-9456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14523275#comment-14523275 ] Thejas M Nair commented on HIVE-9456: - +1 Make Hive support unicode with MSSQL as Metastore backend - Key: HIVE-9456 URL: https://issues.apache.org/jira/browse/HIVE-9456 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.14.0 Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou Attachments: HIVE-9456.1.patch, HIVE-9456.2.patch, HIVE-9456.branch-1.2.patch There are significant issues when Hive uses MSSQL as metastore backend to support unicode, since MSSQL handles varchar and nvarchar datatypes differently. Hive 0.14 metastore mssql script DDL was using varchar as datatype, which can't handle multi-bytes/unicode characters, e.g., Chinese chars. This JIRA is going to track implementation of unicode support in that case. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
