[
https://issues.apache.org/jira/browse/KYLIN-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shao Feng Shi closed KYLIN-1844.
--------------------------------
Resolution: Won't Fix
Kylin 4.0 will use parquet to store dimensions, no dictionary in Kylin anymore.
> Hold huge dictionary in 2nd storage like disk/hbase
> ---------------------------------------------------
>
> Key: KYLIN-1844
> URL: https://issues.apache.org/jira/browse/KYLIN-1844
> Project: Kylin
> Issue Type: Improvement
> Components: Query Engine
> Affects Versions: v1.2, v1.5.2
> Reporter: Abhilash L L
> Assignee: liyang
> Priority: Major
>
> A whole dimension is kept in memory.
> We should have a way to keep only certain number / size of total rows to be
> kept in memory. A LRU cache for rows in the dimension will help keep memory
> in check.
> Why not store all the dimensions data in hbase in a different table with a
> prefix of dimensionid, and all calls to the dimensions (get based on dim
> key), is mapped to hbase.
> This does mean it will cost more time on a miss.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
