[
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16209083#comment-16209083
]
Yifei Wu edited comment on KYLIN-2945 at 10/18/17 11:53 AM:
------------------------------------------------------------
the solution is changing the absolute path to relative path when creating new
dict and convert the relative path to correct absolute path by getting the
working directory from configuration when reading. At the same time, it deals
with the former absolute path when reading from the FileSystem.
was (Author: yifei_wu94):
the solution is changing the absolute path to relative path when creating new
dict, and dealing with the former absolute path when reading from the
FileSystem at the same time.
> global dict specific info use absolute path when saved it
> ---------------------------------------------------------
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
> Issue Type: Improvement
> Reporter: Yifei Wu
>
> Currently, absolute path is used in the global dictionary for saving the
> location of specific info like the next json.
> {code}
> {
> "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
> "last_modified" : 0,
> "version" : "2.3.0.20500",
> "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
> "source_column" : "PRICE",
> "source_column_index" : 6,
> "data_type" : "decimal(19,4)",
> "input" : {
> "path" :
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
> },
> "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
> "cardinality" : 8878
> }^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> {code}
> But if you change the path configuration or migrate the data to another
> cluster which node name is different or original host cannot be reached, you
> will meet problems in reusing it, like rebuilding and merge dictionary or
> transfer column from dictionary in building cube, for the dictionary info
> cannot be found.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
