[
https://issues.apache.org/jira/browse/KYLIN-2457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15930989#comment-15930989
]
Shaofeng SHI commented on KYLIN-2457:
-------------------------------------
Good catch, thanks zhengdong.
Chenney, would you like to share your tool? Kylin has a "tool" module, in which
there are a couple of CLI for different purposes, your tool can be added there.
> Should copy the latest dictionaries on dimension tables in a batch merge job
> ----------------------------------------------------------------------------
>
> Key: KYLIN-2457
> URL: https://issues.apache.org/jira/browse/KYLIN-2457
> Project: Kylin
> Issue Type: Bug
> Affects Versions: v1.6.0
> Reporter: zhengdong
> Assignee: zhengdong
> Priority: Critical
> Fix For: v2.0.0
>
> Attachments:
> 0001-KYLIN-2457-Should-copy-the-latest-dictionaries-on-di.patch, kylintools.7z
>
>
> In a batch merge job, we need to create dictionaries for all dimensions for
> the new segment. For those dictionaries on dimension table, we currently just
> copy them from the earliest segment of the merging segments.
> However, we should select the newest dictionary for the new segment, since
> the incremental dimension table is allowed. The older dictionary can't find
> the records corresponding to the new key added to a dimension table and lead
> wrong query result.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
