Manish Gupta created CARBONDATA-1217:
----------------------------------------
Summary: Failure in data load when we first load the bad record
and then valid record and bad record action is set to Fail
Key: CARBONDATA-1217
URL: https://issues.apache.org/jira/browse/CARBONDATA-1217
Project: CarbonData
Issue Type: Bug
Reporter: Manish Gupta
Assignee: Manish Gupta
Priority: Minor
Fix For: 1.2.0
Attachments: bigtabbad.csv, bigtab.csv
When we load bad record into the table and bad record action is set to "FAIL",
then data load will fail. During load a bad record logger static map is
maintained which holds the key for bad record. When data load fails due to bad
record exception is thrown and key from bad record logger static map is not
cleared because of which when valid data is loaded next time data load fails
because the key still exists in the map.
Steps to reproduce
-------------------------------
Execute the below commands in sequence in the same session.
create table bigtab (val string, bal int) STORED BY 'carbondata'
load data inpath 'bigtabbad.csv' into table bigtab
options('DELIMITER'=',','QUOTECHAR'='"','BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='val,bal')
load data inpath 'bigtab.csv' into table bigtab
options('DELIMITER'=',','QUOTECHAR'='"','BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='val,bal')
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
