[ 
https://issues.apache.org/jira/browse/HIVE-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17359767#comment-17359767
 ] 

Taraka Rama Rao Lethavadla commented on HIVE-25150:
---------------------------------------------------

Added support to skip below characters as part of this request


HORIZONTAL_TABULATION ('\u0009')
VERTICAL_TABULATION ('\u000B')
FORM_FEED ('\u000C')

> Tab characters are not removed before decimal conversion similar to space 
> character which is fixed as part of HIVE-24378
> ------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-25150
>                 URL: https://issues.apache.org/jira/browse/HIVE-25150
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>    Affects Versions: 4.0.0
>            Reporter: Taraka Rama Rao Lethavadla
>            Assignee: Taraka Rama Rao Lethavadla
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Test case: 
>  column values with space and tab character 
> {noformat}
> bash-4.2$ cat data/files/test_dec_space.csv
> 1,0
> 2, 1
> 3,    2{noformat}
> {noformat}
> create external table test_dec_space (id int, value decimal) ROW FORMAT 
> DELIMITED
>  FIELDS TERMINATED BY ',' location '/tmp/test_dec_space';
> {noformat}
> output of select * from test_dec_space would be
> {noformat}
> 1     0
> 2     1
> 3     NULL{noformat}
> The behaviour in MySQL when there is tab & space characters in decimal values
> {noformat}
> bash-4.2$ cat /tmp/insert.csv 
> "1","aa",11.88
> "2","bb", 99.88
> "4","dd",     209.88{noformat}
>  
> {noformat}
> MariaDB [test]> load data local infile '/tmp/insert.csv' into table t2 fields 
> terminated by ',' ENCLOSED BY '"' LINES TERMINATED BY '\n';
>  Query OK, 3 rows affected, 3 warnings (0.00 sec) 
>  Records: 3 Deleted: 0 Skipped: 0 Warnings: 3
> MariaDB [test]> select * from t2;
> +------+------+-------+
> | id   | name | score |
> +------+------+-------+
> | 1    | aa   |    12 |
> | 2    | bb   |   100 |
> | 4    | dd   |   210 |
> +------+------+-------+
>  3 rows in set (0.00 sec)
> {noformat}
> So in hive also we can make it work by skipping tab character



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to