[
https://issues.apache.org/jira/browse/CARBONDATA-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ajantha Bhat updated CARBONDATA-3515:
-------------------------------------
Fix Version/s: 1.6.1
> Limit local dictionary size to 10% of allowed blocklet size
> -----------------------------------------------------------
>
> Key: CARBONDATA-3515
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3515
> Project: CarbonData
> Issue Type: Improvement
> Reporter: Ajantha Bhat
> Assignee: Kumar Vishal
> Priority: Major
> Fix For: 1.6.1
>
> Time Spent: 4h 20m
> Remaining Estimate: 0h
>
> problem: currently local dictionary max size is 2GB, because of this for
> varchar columns or long string columns, local dictionary can be of 2GB size.
> so, as local dictionary is stored in blocklet. blocklet size will exceed 2
> GB, even though configured maximum blocklet size is 64MB. some places inter
> overflow happens during casting.
>
> solution: limit the local dictionary size to 10% of maximum allowed blocklet
> size
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
