[
https://issues.apache.org/jira/browse/HIVE-25150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Taraka Rama Rao Lethavadla updated HIVE-25150:
----------------------------------------------
Description:
Test case:
column values with space and tab character
{noformat}
bash-4.2$ cat data/files/test_dec_space.csv
1,0
2, 1
3, 2{noformat}
{noformat}
create external table test_dec_space (id int, value decimal) ROW FORMAT
DELIMITED
FIELDS TERMINATED BY ',' location '/tmp/test_dec_space';
{noformat}
output of select * from test_dec_space would be
{noformat}
1 0
2 1
3 NULL{noformat}
The behaviour in MySQL when there is tab & space characters in decimal values
{noformat}
bash-4.2$ cat /tmp/insert.csv
"1","aa",11.88
"2","bb", 99.88
"4","dd", 209.88{noformat}
{noformat}
MariaDB [test]> load data local infile '/tmp/insert.csv' into table t2 fields
terminated by ',' ENCLOSED BY '"' LINES TERMINATED BY '\n';
Query OK, 3 rows affected, 3 warnings (0.00 sec)
Records: 3 Deleted: 0 Skipped: 0 Warnings: 3
MariaDB [test]> select * from t2;
---------++------
id name score
---------++------
1 aa 12 2 bb 100 4 dd 210
---------++------
3 rows in set (0.00 sec)
{noformat}
So hive should not show up NULL
was:
Test case:
column values with space and tab character
{noformat}
bash-4.2$ cat data/files/test_dec_space.csv
1,0
2, 1
3, 2{noformat}
{noformat}
create external table test_dec_space (id int, value decimal) ROW FORMAT
DELIMITED
FIELDS TERMINATED BY ',' location '/tmp/test_dec_space';
{noformat}
output of select * from test_dec_space would be
{noformat}
1 0
2 1
3 NULL{noformat}
The behaviour in MySQL when there is tab & space characters in decimal values
bash-4.2$ cat /tmp/insert.csv
"1","aa",11.88
"2","bb", 99.88
"4","dd", 209.88
MariaDB [test]> load data local infile '/tmp/insert.csv' into table t2 fields
terminated by ',' ENCLOSED BY '"' LINES TERMINATED BY '\n';
Query OK, 3 rows affected, 3 warnings (0.00 sec)
Records: 3 Deleted: 0 Skipped: 0 Warnings: 3
MariaDB [test]> select * from t2;
+-------+-----++-------
|id|name|score|
+-------+-----++-------
|1|aa|12|
|2|bb|100|
|4|dd|210|
+-------+-----++-------
3 rows in set (0.00 sec)
So hive should not show up NULL
> Tab characters are not removed before decimal conversion similar to space
> character which is fixed as part of HIVE-24378
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-25150
> URL: https://issues.apache.org/jira/browse/HIVE-25150
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Affects Versions: 4.0.0
> Reporter: Taraka Rama Rao Lethavadla
> Priority: Major
>
> Test case:
> column values with space and tab character
> {noformat}
> bash-4.2$ cat data/files/test_dec_space.csv
> 1,0
> 2, 1
> 3, 2{noformat}
> {noformat}
> create external table test_dec_space (id int, value decimal) ROW FORMAT
> DELIMITED
> FIELDS TERMINATED BY ',' location '/tmp/test_dec_space';
> {noformat}
> output of select * from test_dec_space would be
> {noformat}
> 1 0
> 2 1
> 3 NULL{noformat}
> The behaviour in MySQL when there is tab & space characters in decimal values
> {noformat}
> bash-4.2$ cat /tmp/insert.csv
> "1","aa",11.88
> "2","bb", 99.88
> "4","dd", 209.88{noformat}
>
> {noformat}
> MariaDB [test]> load data local infile '/tmp/insert.csv' into table t2 fields
> terminated by ',' ENCLOSED BY '"' LINES TERMINATED BY '\n';
> Query OK, 3 rows affected, 3 warnings (0.00 sec)
> Records: 3 Deleted: 0 Skipped: 0 Warnings: 3
> MariaDB [test]> select * from t2;
> ---------++------
> id name score
> ---------++------
> 1 aa 12 2 bb 100 4 dd 210
> ---------++------
> 3 rows in set (0.00 sec)
> {noformat}
> So hive should not show up NULL
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
