Ajantha Bhat created CARBONDATA-3186:
----------------------------------------
Summary: NPE when all the records in a file is badrecord with
action redirect/ignore
Key: CARBONDATA-3186
URL: https://issues.apache.org/jira/browse/CARBONDATA-3186
Project: CarbonData
Issue Type: Bug
Reporter: Ajantha Bhat
Assignee: Ajantha Bhat
*problem:* In the no_sort flow, writer will be open as there is no blocking
sort step.
So, when all the record goes as bad record with redirect in converted step.
writer is closing the empty .carbondata file.
when this empty carbondata file is queried , we get multiple issues including
NPE.
*solution:* When the file size is 0 bytes. do the following
a) If one data and one index file -- delete carbondata file and avoid index
file creation
b) If multiple data and one index file (with few data file is full of bad
recod) -- delete carbondata files, remove them from blockIndexInfoList, so
index file not will not have that info of empty carbon files
c) In case direct write to store path is enable. need to delete data file from
there and avoid writing index file with that carbondata in info.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
