[
https://issues.apache.org/jira/browse/HIVE-22360?focusedWorklogId=440849&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-440849
]
ASF GitHub Bot logged work on HIVE-22360:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 03/Jun/20 15:55
Start Date: 03/Jun/20 15:55
Worklog Time Spent: 10m
Work Description: belugabehr commented on pull request #823:
URL: https://github.com/apache/hive/pull/823#issuecomment-638288379
Take a look at my related PR #815
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 440849)
Time Spent: 20m (was: 10m)
> MultiDelimitSerDe returns wrong results in last column when the loaded file
> has more columns than those in table schema
> -----------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-22360
> URL: https://issues.apache.org/jira/browse/HIVE-22360
> Project: Hive
> Issue Type: Bug
> Components: Serializers/Deserializers
> Affects Versions: 4.0.0
> Reporter: Shubham Chaurasia
> Assignee: Shubham Chaurasia
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Attachments: HIVE-22360.1.patch, HIVE-22360.2.patch,
> HIVE-22360.3.patch
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Repro steps:
> Input file:
> {code}
> 1^,1^,^,0^,0^,0
> 2^,1^,^,0^,1^,0
> 3^,1^,^,0^,0^,0
> 4^,1^,^,0^,1^,0
> {code}
> Queries:
> {code}
> CREATE TABLE n2(colA int, colB tinyint, colC timestamp, colD smallint, colE
> smallint) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.MultiDelimitSerDe'
> WITH SERDEPROPERTIES ("field.delim"="^,")STORED AS TEXTFILE;
> LOAD DATA LOCAL INPATH '/Users/schaurasia/Documents/input_6_cols.csv'
> OVERWRITE INTO TABLE n2;
> select * from n2;
> // wrong last column results here.
> +----------+----------+----------+----------+----------+
> | n2.cola | n2.colb | n2.colc | n2.cold | n2.cole |
> +----------+----------+----------+----------+----------+
> | 1 | 1 | NULL | 0 | NULL |
> | 2 | 1 | NULL | 0 | NULL |
> | 3 | 1 | NULL | 0 | NULL |
> | 4 | 1 | NULL | 0 | NULL |
> +----------+----------+----------+----------+----------+
> {code}
> Cause:
> In multi-serde parsing, the total length calculation here:
> https://github.com/apache/hive/blob/rel/release-3.1.2/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyStruct.java#L308
> does not take extra fields into account.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
