[
https://issues.apache.org/jira/browse/TRAFODION-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14715218#comment-14715218
]
Selvaganesan Govindarajan edited comment on TRAFODION-1453 at 8/26/15 5:49 PM:
-------------------------------------------------------------------------------
Use case for this issue:
The data was in hbase table. We need to load this data from hbase to Trafodion.
You need to do the following:
1. create a hbase mapped hive table using
storage_handler=org.apache.hadoop.hive.hbase.HBaseStorageHandler and
serdeInfo:SerDeInfo(name:null,
serializationLib:org.apache.hadoop.hive.hbase.HBaseSerDe and the column mapping
between hbase and hive.
2. create a hive table with
inputFormat:org.apache.hadoop.mapred.TextInputFormat for Trafodion to use as
source table (textInputHiveTable)
3. insert into textInputHiveTable selecting from HbaseMappedHiveTable in hive
shell
4, In Trafodion, use sqlci to create a trafodion table
5. Use bulk load command - load with log error rows into trafodion_table from
select * from hive.hive.textInputHiveTable
was (Author: selvag):
Use case for this issue:
The data was in hbase table. We need to load this data from hbase to Trafodion.
You need to do the following:
1. create a hbase mapped hive table using
storage_handler=org.apache.hadoop.hive.hbase.HBaseStorageHandler and
serdeInfo:SerDeInfo(name:null,
serializationLib:org.apache.hadoop.hive.hbase.HBaseSerDe and the column mapping
between hbase and hive.
2. create a hive table with
inputFormat:org.apache.hadoop.mapred.TextInputFormat for Trafodion to use as
source table
3. insert into table in option 2 selecting from table in opton 1 in hive shell
4, In Trafodion, use sqlci to create a trafodion table
5. Use bulk load command - load with log error rows into trafodion_table from
select * from hive.hive.hivetable in option 2.
> A null character in hive TEXTFILE format is not reported as an error
> --------------------------------------------------------------------
>
> Key: TRAFODION-1453
> URL: https://issues.apache.org/jira/browse/TRAFODION-1453
> Project: Apache Trafodion
> Issue Type: Bug
> Components: sql-exe
> Affects Versions: 0.6 (pre-incubation)
> Reporter: Selvaganesan Govindarajan
> Fix For: 2.0-incubating
>
>
> Trafodion engine expects the data in hive TEXTFILE format shouldn't have any
> null character. Currently, Trafodion supports only ISO88591 and UTF8
> character set string data only. When there is a null characterthe engine
> continues to read all the data without producing any output.
> An error should be reported instead.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
