[
https://issues.apache.org/jira/browse/CARBONDATA-1217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ravindra Pesala resolved CARBONDATA-1217.
-----------------------------------------
Resolution: Fixed
> Failure in data load when we first load the bad record and then valid record
> and bad record action is set to Fail
> -----------------------------------------------------------------------------------------------------------------
>
> Key: CARBONDATA-1217
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1217
> Project: CarbonData
> Issue Type: Bug
> Reporter: Manish Gupta
> Assignee: Manish Gupta
> Priority: Minor
> Fix For: 1.2.0
>
> Attachments: bigtabbad.csv, bigtab.csv
>
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> When we load bad record into the table and bad record action is set to
> "FAIL", then data load will fail. During load a bad record logger static map
> is maintained which holds the key for bad record. When data load fails due to
> bad record exception is thrown and key from bad record logger static map is
> not cleared because of which when valid data is loaded next time data load
> fails because the key still exists in the map.
> Steps to reproduce
> -------------------------------
> Execute the below commands in sequence in the same session.
> create table bigtab (val string, bal int) STORED BY 'carbondata'
> load data inpath 'bigtabbad.csv' into table bigtab
> options('DELIMITER'=',','QUOTECHAR'='"','BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='val,bal')
> load data inpath 'bigtab.csv' into table bigtab
> options('DELIMITER'=',','QUOTECHAR'='"','BAD_RECORDS_ACTION'='FAIL','FILEHEADER'='val,bal')
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
