[
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yifei Wu updated KYLIN-2945:
----------------------------
Description:
Currently, absolute path is used in the global dictionary for saving the
location of specific info. But if you change the host configuration or migrate
the data to another data. So you may meet problems that the dictionary cannot
be found and reuse it after configuration changed or data migration.
{code}
{
"uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
"last_modified" : 0,
"version" : "2.3.0.20500",
"source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
"source_column" : "PRICE",
"source_column_index" : 6,
"data_type" : "decimal(19,4)",
"input" : {
"path" :
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
},
"dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
"cardinality" : 8878
}^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}
was:
Absolute path is used in global dictionary, which may cause the dict cannot be
found after configuration changed or migration.
{code}
{
"uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
"last_modified" : 0,
"version" : "2.3.0.20500",
"source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
"source_column" : "PRICE",
"source_column_index" : 6,
"data_type" : "decimal(19,4)",
"input" : {
"path" :
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
},
"dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
"cardinality" : 8878
}^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}
> global dict specific info use absolute path when saved it
> ---------------------------------------------------------
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
> Issue Type: Improvement
> Reporter: Yifei Wu
>
> Currently, absolute path is used in the global dictionary for saving the
> location of specific info. But if you change the host configuration or
> migrate the data to another data. So you may meet problems that the
> dictionary cannot be found and reuse it after configuration changed or data
> migration.
> {code}
> {
> "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
> "last_modified" : 0,
> "version" : "2.3.0.20500",
> "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
> "source_column" : "PRICE",
> "source_column_index" : 6,
> "data_type" : "decimal(19,4)",
> "input" : {
> "path" :
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
> },
> "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
> "cardinality" : 8878
> }^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
