[
https://issues.apache.org/jira/browse/KYLIN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16729282#comment-16729282
]
kangkaisen commented on KYLIN-3430:
-----------------------------------
[~temple.zhou] ， Thanks for your patch.
The global dict paths in HDFS have two format:
for `GlobalDictionaryBuilder`：the HDFS path is `String baseDir = hdfsDir +
"resources/GlobalDict" + dictInfo.getResourceDir() + "/"`,
for `SegmentAppendTrieDictBuilder`： the HDFS path is `String baseDir = hdfsDir
+ "resources/SegmentDict" + dictInfo.getResourceDir() + "/"+
RandomUtil.randomUUID().toString() + "_" + System.currentTimeMillis() + "/";`
Please handle the SegmentDict， thanks you.
> Global Dictionary Cleanup
> -------------------------
>
> Key: KYLIN-3430
> URL: https://issues.apache.org/jira/browse/KYLIN-3430
> Project: Kylin
> Issue Type: Improvement
> Components: Tools, Build and Test
> Affects Versions: v2.1.0, v2.2.0, v2.3.0, v2.3.1, v2.4.0
> Reporter: Temple Zhou
> Assignee: Temple Zhou
> Priority: Major
> Attachments: KYLIN-3430.master.002.patch
>
>
> I had run "{{./bin/metastore.sh clean --delete true" to cleanup my Kylin
> metadata, but, after that, the Global Dictionary still exists in my HDFS and
> the size of directory "/kylin_metadata/resources/GlobalDict/dict" hasn't
> shrunk.}}
>
> {{BTW: I'm very sure that there are redundant Global Dictionaries.}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
