[
https://issues.apache.org/jira/browse/CARBONDATA-3186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
kumar vishal resolved CARBONDATA-3186.
--------------------------------------
Resolution: Fixed
> NPE when all the records in a file is badrecord with action redirect/ignore
> ---------------------------------------------------------------------------
>
> Key: CARBONDATA-3186
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3186
> Project: CarbonData
> Issue Type: Bug
> Reporter: Ajantha Bhat
> Assignee: Ajantha Bhat
> Priority: Major
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> *problem:* In the no_sort flow, writer will be open as there is no blocking
> sort step.
> So, when all the record goes as bad record with redirect in converted step.
> writer is closing the empty .carbondata file.
> when this empty carbondata file is queried , we get multiple issues including
> NPE.
> *solution:* When the file size is 0 bytes. do the following
> a) If one data and one index file -- delete carbondata file and avoid index
> file creation
> b) If multiple data and one index file (with few data file is full of bad
> recod) -- delete carbondata files, remove them from blockIndexInfoList, so
> index file not will not have that info of empty carbon files
> c) In case direct write to store path is enable. need to delete data file
> from there and avoid writing index file with that carbondata in info.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
