Shaofeng SHI created KYLIN-1178:
-----------------------------------

             Summary: Build dictionary out of job engine
                 Key: KYLIN-1178
                 URL: https://issues.apache.org/jira/browse/KYLIN-1178
             Project: Kylin
          Issue Type: Improvement
          Components: Job Engine
            Reporter: Shaofeng SHI
            Assignee: ZhouQianhao


Kylin build dictionary in job engine node, usually this is okay. But if there 
is some high cardinality dimentions, the JVM heap couldn't fit in all distinct 
values, then job engine instance will crash with OOM error.

Need to enhance on this, move the dictionary building to another process or a 
hadoop node.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to