[
https://issues.apache.org/jira/browse/KYLIN-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15382225#comment-15382225
]
hongbin ma commented on KYLIN-1894:
-----------------------------------
hi yerui
is there any documentation for global dict? is it to address the non-integer
precise distinct count issue?
someone is asking "How Kylin use bitmap to calculte the cardinality of
non-integer field?" in the mail list.
It's best if you could introduce a little bit
> GlobalDictionary may corrupt when server suddenly crash
> -------------------------------------------------------
>
> Key: KYLIN-1894
> URL: https://issues.apache.org/jira/browse/KYLIN-1894
> Project: Kylin
> Issue Type: Improvement
> Components: Metadata
> Affects Versions: v1.5.3
> Reporter: Yerui Sun
> Assignee: Yerui Sun
> Fix For: v1.5.3
>
> Attachments: KYLIN-1894.2.patch, KYLIN-1894.3.patch
>
>
> Global Dictionary store data on hdfs directly, and overwrite directly when
> data file updated. If the server crashed suddenly during writing file, the
> data file may be corrupt and can't be recovered.
> To resolve this problem, copy the data file into a tmp directory and copy
> back after the file is updated successfully.
> I'll post a patch later with this solution.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
