[
https://issues.apache.org/jira/browse/TRAFODION-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716822#comment-14716822
]
ASF GitHub Bot commented on TRAFODION-1453:
-------------------------------------------
GitHub user selvaganesang opened a pull request:
https://github.com/apache/incubator-trafodion/pull/67
[TRAFODION-1453] Improvements in Hive Scan
The null byte is now skipped over to look for the column and record
delimiter while scanning the hdfs row buffer. The null byte will be part of the
column value. The behavior of null byte in the column value is unknown.
Skipping over null byte is now in sync with other tool's behavior.
Also, improved the code to scan the buffer for both record and column
delimiter once. Earlier, the buffer was scanned twice; once for the record
delimiter and another for column delimiter.
No errors are returned when null byte is found.
A sql error 7002 is now reported when a unsupported row format type is
accessed from Trafodion.
*** ERROR[7002] The input row format of the hive table is not yet supported.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/selvaganesang/incubator-trafodion
trafodion-1453
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-trafodion/pull/67.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #67
----
commit 5d4e0a927e801d78d97e36938d6bf2261f8e9769
Author: selvaganesang <[email protected]>
Date: 2015-08-27T00:51:58Z
[TRAFODION-1453] Improvements in Hive Scan
The null byte is now skipped over to look for the column
and record delimiter while scanning the hdfs row buffer.
The null byte will be part of the column value.
The behavior of null byte in the column value is unknown.
Skipping over null byte is now in sync with other tool's
behavior.
Also, improved the code to scan the buffer for both record and
column delimiter once. Earlier, the buffer was scanned twice;
once for the record delimiter and another for column delimiter.
No errors are returned when null byte is found.
A sql error 7002 is now reported when a unspported row format type is
accessed
from Trafodion.
*** ERROR[7002] The input row format of the hive table is not yet supported.
----
> A null character in hive TEXTFILE format is not reported as an error
> --------------------------------------------------------------------
>
> Key: TRAFODION-1453
> URL: https://issues.apache.org/jira/browse/TRAFODION-1453
> Project: Apache Trafodion
> Issue Type: Bug
> Components: sql-exe
> Affects Versions: 0.6 (pre-incubation)
> Reporter: Selvaganesan Govindarajan
> Fix For: 2.0-incubating
>
>
> Trafodion engine expects the data in hive TEXTFILE format shouldn't have any
> null character. Currently, Trafodion supports only ISO88591 and UTF8
> character set string data only. When there is a null characterthe engine
> continues to read all the data without producing any output.
> An error should be reported instead.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
