ASF GitHub Bot commented on CARBONDATA-260:

Github user asfgit closed the pull request at:


> Equal or lesser value of MAXCOLUMNS option than column count in CSV header 
> results into array index of bound exception
> ----------------------------------------------------------------------------------------------------------------------
>                 Key: CARBONDATA-260
>                 URL: https://issues.apache.org/jira/browse/CARBONDATA-260
>             Project: CarbonData
>          Issue Type: Bug
>            Reporter: Manish Gupta
>            Assignee: Manish Gupta
>             Fix For: 0.2.0-incubating
> If column count in CSV header is more or equal to MAXCOLUMNS option value 
> then array index out of bound exception is thrown by the Univocity CSV 
> parser. This is because while parsing the row, parser adds each row to an 
> array and increments the index and after incrementing it performs one more 
> operation using the incremented index value which leads to array index pf 
> bound exception
> java.lang.OutOfMemoryError: Java heap space
> at com.univocity.parsers.common.ParserOutput.<init>(ParserOutput.java:86)
> at com.univocity.parsers.common.AbstractParser.<init>(AbstractParser.java:66)
> at com.univocity.parsers.csv.CsvParser.<init>(CsvParser.java:50)
> at 
> org.apache.carbondata.processing.csvreaderstep.UnivocityCsvParser.initialize(UnivocityCsvParser.java:114)
> at 
> org.apache.carbondata.processing.csvreaderstep.CsvInput.doProcessUnivocity(CsvInput.java:427)
> at 
> org.apache.carbondata.processing.csvreaderstep.CsvInput.access$100(CsvInput.java:60)
> at 
> org.apache.carbondata.processing.csvreaderstep.CsvInput$1.call(CsvInput.java:389)

This message was sent by Atlassian JIRA

Reply via email to