[
https://issues.apache.org/jira/browse/CARBONDATA-229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15473352#comment-15473352
]
ASF GitHub Bot commented on CARBONDATA-229:
-------------------------------------------
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-carbondata/pull/143
> Array Index of bound exception thrown from dictionary look up while writing
> sort index file
> -------------------------------------------------------------------------------------------
>
> Key: CARBONDATA-229
> URL: https://issues.apache.org/jira/browse/CARBONDATA-229
> Project: CarbonData
> Issue Type: Bug
> Reporter: Manish Gupta
> Assignee: Manish Gupta
>
> Whenever we load dictionary data into memory, then in case of populating
> reverse dictionary object sometimes a chunk which has no value is also
> getting added to the dictionary chunk list. This is happening because the
> logic for dictionary chunk distribution in case of forward dictionary is not
> implemented for reverse dictionary and 0 size dictionary chunks are not
> getting removed while adding to the list of dictionary chunks.
> java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> at java.util.ArrayList.rangeCheck(ArrayList.java:653)
> at java.util.ArrayList.get(ArrayList.java:429)
> at
> org.apache.carbondata.core.cache.dictionary.DictionaryChunksWrapper.next(DictionaryChunksWrapper.java:92)
> at
> org.apache.carbondata.core.writer.sortindex.CarbonDictionarySortInfoPreparator.prepareDictionarySortModels(CarbonDictionarySortInfoPreparator.java:120)
> at
> org.apache.carbondata.core.writer.sortindex.CarbonDictionarySortInfoPreparator.getDictionarySortInfo(CarbonDictionarySortInfoPreparator.java:51)
> at
> org.apache.carbondata.spark.tasks.SortIndexWriterTask.execute(SortIndexWriterTask.scala:44)
> at
> org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD$$anon$1.<init>(CarbonGlobalDictionaryRDD.scala:387)
> at
> org.apache.carbondata.spark.rdd.CarbonGlobalDictionaryGenerateRDD.compute(CarbonGlobalDictionaryRDD.scala:294)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
