[jira] [Updated] (KYLIN-2846) Add a config of hbase namespace for cube storage

2017-10-18 Thread zeng.yaowu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zeng.yaowu updated KYLIN-2846:
--
Attachment: kYLIN-2846-001-cleanhtable.patch

upload the patch and please check it   ,thanks 

> Add a config of hbase namespace for cube storage
> 
>
> Key: KYLIN-2846
> URL: https://issues.apache.org/jira/browse/KYLIN-2846
> Project: Kylin
>  Issue Type: New Feature
>  Components: Storage - HBase
>Affects Versions: v2.1.0
>Reporter: Liu Shaohui
>Assignee: Liu Shaohui
>Priority: Minor
>  Labels: scope
> Fix For: v2.3.0
>
> Attachments: KYLIN-2846-001-addium.patch, KYLIN-2846-001.patch, 
> kYLIN-2846-001-cleanhtable.patch
>
>
> In multi-tenancy HBase cluster, namespace is important for quota management 
> and permission control. So we add a global configuration of hbase namespace 
> for cube storage.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (KYLIN-2946) Introduce a tool for batch incremental building of system cubes

2017-10-18 Thread Zhong Yanghong (JIRA)
Zhong Yanghong created KYLIN-2946:
-

 Summary: Introduce a tool for batch incremental building of system 
cubes
 Key: KYLIN-2946
 URL: https://issues.apache.org/jira/browse/KYLIN-2946
 Project: Kylin
  Issue Type: Sub-task
Reporter: Zhong Yanghong
Assignee: Zhong Yanghong






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (KYLIN-2931) Update correct cardinality for the modified table

2017-10-18 Thread peng.jianhua (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16209239#comment-16209239
 ] 

peng.jianhua commented on KYLIN-2931:
-

sorry,it was resolved.

> Update correct cardinality for the modified table
> -
>
> Key: KYLIN-2931
> URL: https://issues.apache.org/jira/browse/KYLIN-2931
> Project: Kylin
>  Issue Type: Bug
>  Components: Web 
>Affects Versions: v2.0.0
>Reporter: peng.jianhua
>Assignee: peng.jianhua
>Priority: Minor
>  Labels: patch
> Attachments: 
> 0001-KYLIN-2931-Update-correct-cardinality-for-the-modifi.patch, 01.PNG, 
> 02.PNG, 03.PNG, 04.PNG, 05.PNG, 06.PNG, 07.PNG, 08.PNG, Screen Shot 
> 2017-10-12 at 4.32.24 PM.png
>
>
> 1,Add project_1;
> 2,Do the following steps:
> a,use 'create table kylin_sales_copy as select * from kylin_sales;' to copy 
> table kylin_sales;
> b,load table kylin_sales_copy and calculate column cardinality in project_1 
> on the web,please refer to 01.png.
> c,use 'drop table kylin_sales_copy;' to drop table kylin_sales_copy;
> d,use 'create table kylin_sales_copy as select 
> TRANS_ID,PART_DT,LSTG_FORMAT_NAME,LEAF_CATEG_ID,LSTG_SITE_ID,SLR_SEGMENT_CD,PRICE
>  from kylin_sales where price < 20;' to create the new kylin_sales_copy table;
> Now the structure of kylin_sales_copy has changed, the same as the 
> cardinality.
> 3,Reload table kylin_sales_copy in project_1,we found that the cardinality is 
> not change,please refer to 02.png.
> However,I found that the new cardinality was calculated but not update on the 
> web by debug the code,please refer to 03.png,04.png.It should update correct 
> cardinality like 05.png.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (KYLIN-2945) global dict specific info should not use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yifei Wu updated KYLIN-2945:

Summary: global dict specific info should not use absolute path when saved 
it  (was: global dict specific info use absolute path when saved it)

> global dict specific info should not use absolute path when saved it
> 
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Yifei Wu
>
> Currently, absolute path is used in the global dictionary for saving the 
> location of specific info like the next json.
> {code}
> {
>   "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
>   "last_modified" : 0,
>   "version" : "2.3.0.20500",
>   "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
>   "source_column" : "PRICE",
>   "source_column_index" : 6,
>   "data_type" : "decimal(19,4)",
>   "input" : {
> "path" : 
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
>   },
>   "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
>   "cardinality" : 8878
> }^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> {code}
> But if you change the path configuration or migrate the data to another 
> cluster which node name is different or original host cannot be reached, you 
> will meet problems in reusing it, like rebuilding and merge dictionary or 
> transfer column from dictionary in building cube, for the dictionary info 
> cannot be found.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Comment Edited] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16209083#comment-16209083
 ] 

Yifei Wu edited comment on KYLIN-2945 at 10/18/17 11:53 AM:


the solution is changing the absolute path to relative path when creating new 
dict and convert the relative path to correct absolute path by getting the 
working directory from configuration when reading. At the same time, it deals 
with the former absolute path when reading from the FileSystem.


was (Author: yifei_wu94):
the solution is changing the absolute path to relative path when creating new 
dict, and dealing with the former absolute path when reading from the 
FileSystem at the same time.

> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Yifei Wu
>
> Currently, absolute path is used in the global dictionary for saving the 
> location of specific info like the next json.
> {code}
> {
>   "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
>   "last_modified" : 0,
>   "version" : "2.3.0.20500",
>   "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
>   "source_column" : "PRICE",
>   "source_column_index" : 6,
>   "data_type" : "decimal(19,4)",
>   "input" : {
> "path" : 
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
>   },
>   "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
>   "cardinality" : 8878
> }^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> {code}
> But if you change the path configuration or migrate the data to another 
> cluster which node name is different or original host cannot be reached, you 
> will meet problems in reusing it, like rebuilding and merge dictionary or 
> transfer column from dictionary in building cube, for the dictionary info 
> cannot be found.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Comment Edited] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16209083#comment-16209083
 ] 

Yifei Wu edited comment on KYLIN-2945 at 10/18/17 11:48 AM:


the solution is changing the absolute path to relative path when creating new 
dict, and dealing with the former absolute path when reading from the 
FileSystem at the same time.


was (Author: yifei_wu94):
will solve it by changing the absolute path to relative path when creating new 
dict and dealing with the former absolute path when reading from the FileSystem

> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Yifei Wu
>
> Currently, absolute path is used in the global dictionary for saving the 
> location of specific info like the next json.
> {code}
> {
>   "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
>   "last_modified" : 0,
>   "version" : "2.3.0.20500",
>   "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
>   "source_column" : "PRICE",
>   "source_column_index" : 6,
>   "data_type" : "decimal(19,4)",
>   "input" : {
> "path" : 
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
>   },
>   "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
>   "cardinality" : 8878
> }^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> {code}
> But if you change the path configuration or migrate the data to another 
> cluster which node name is different or original host cannot be reached, you 
> will meet problems in reusing it, like rebuilding and merge dictionary or 
> transfer column from dictionary in building cube, for the dictionary info 
> cannot be found.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yifei Wu updated KYLIN-2945:

Description: 
Currently, absolute path is used in the global dictionary for saving the 
location of specific info like the next json.
{code}
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}
But if you change the path configuration or migrate the data to another cluster 
which node name is different or original host cannot be reached, you will meet 
problems in reusing it, like rebuilding and merge dictionary or transfer column 
from dictionary in building cube, for the dictionary info cannot be found.

  was:
Currently, absolute path is used in the global dictionary for saving the 
location of specific info. But if you change the host configuration or migrate 
the data to another data. So you may meet problems that the dictionary cannot 
be found and reuse it after configuration changed or data migration.
{code}
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}



> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Yifei Wu
>
> Currently, absolute path is used in the global dictionary for saving the 
> location of specific info like the next json.
> {code}
> {
>   "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
>   "last_modified" : 0,
>   "version" : "2.3.0.20500",
>   "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
>   "source_column" : "PRICE",
>   "source_column_index" : 6,
>   "data_type" : "decimal(19,4)",
>   "input" : {
> "path" : 
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
>   },
>   "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
>   "cardinality" : 8878
> }^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> {code}
> But if you change the path configuration or migrate the data to another 
> cluster which node name is different or original host cannot be reached, you 
> will meet problems in reusing it, like rebuilding and merge dictionary or 
> transfer column from dictionary in building cube, for the dictionary info 
> cannot be found.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yifei Wu updated KYLIN-2945:

Description: 
Currently, absolute path is used in the global dictionary for saving the 
location of specific info. But if you change the host configuration or migrate 
the data to another data. So you may meet problems that the dictionary cannot 
be found and reuse it after configuration changed or data migration.
{code}
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}


  was:
Absolute path is used in global dictionary, which may cause the dict cannot be 
found after configuration changed or migration.
{code}
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}



> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Yifei Wu
>
> Currently, absolute path is used in the global dictionary for saving the 
> location of specific info. But if you change the host configuration or 
> migrate the data to another data. So you may meet problems that the 
> dictionary cannot be found and reuse it after configuration changed or data 
> migration.
> {code}
> {
>   "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
>   "last_modified" : 0,
>   "version" : "2.3.0.20500",
>   "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
>   "source_column" : "PRICE",
>   "source_column_index" : 6,
>   "data_type" : "decimal(19,4)",
>   "input" : {
> "path" : 
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
>   },
>   "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
>   "cardinality" : 8878
> }^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (KYLIN-1446) Visualization in Kylin Insight page doesn't work for line chart

2017-10-18 Thread luguosheng (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16209102#comment-16209102
 ] 

luguosheng commented on KYLIN-1446:
---

In query api response body, you can find a key named columnType. if it's value 
equals 91 or 92 or 93, it is a date type column; and -1, 1, 12 is a string type 
column,and -7, -6, -5, 3, 4, 5, 6, 7, 8 is a number type column. 
so we will set date or string type columns as dimension columns , and number 
type columns as measures.
pls check the columnType in your response. maybe there was no dimensions in 
your query response.

> Visualization in Kylin Insight page doesn't work for line chart
> ---
>
> Key: KYLIN-1446
> URL: https://issues.apache.org/jira/browse/KYLIN-1446
> Project: Kylin
>  Issue Type: Bug
>  Components: Web 
>Affects Versions: v1.5.0, v1.4.0
> Environment: PRODUCTION
>Reporter: Hao Chen
>Assignee: Zhong,Jason
>
> Visualization with Line chart in Kylin Insight page doesn't work. 
> When submitting a query to kylin on insight page, and select chart type as 
> line chart, the option selection controller doesn't allow to choose dimension 
> while metric selection works.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (KYLIN-2920) Failed to get streaming config on WebUI

2017-10-18 Thread Zhixiong Chen (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16209099#comment-16209099
 ] 

Zhixiong Chen commented on KYLIN-2920:
--

I have reviewed this patch. Thanks!

> Failed to get streaming config on WebUI
> ---
>
> Key: KYLIN-2920
> URL: https://issues.apache.org/jira/browse/KYLIN-2920
> Project: Kylin
>  Issue Type: Bug
>  Components: Web 
>Affects Versions: v2.2.0
>Reporter: Dong Li
>Assignee: luguosheng
> Fix For: v2.2.0
>
> Attachments: 
> 0001-KYLIN-2920-Failed-to-get-streaming-config-on-WebUI.patch, Screen Shot 
> 2017-10-09 at 10.09.32.png
>
>
> Paramters "project" of rest api call /kylin/api/streaming/getConfig are 
> missed.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

[ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16209083#comment-16209083
 ] 

Yifei Wu commented on KYLIN-2945:
-

will solve it by changing the absolute path to relative path when creating new 
dict and dealing with the former absolute path when reading from the FileSystem

> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Yifei Wu
>
> Absolute path is used in global dictionary, which may cause the dict cannot 
> be found after configuration changed or migration.
> {code}
> {
>   "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
>   "last_modified" : 0,
>   "version" : "2.3.0.20500",
>   "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
>   "source_column" : "PRICE",
>   "source_column_index" : 6,
>   "data_type" : "decimal(19,4)",
>   "input" : {
> "path" : 
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
>   },
>   "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
>   "cardinality" : 8878
> }^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yifei Wu updated KYLIN-2945:

Description: 
Absolute path is used in global dictionary, which may cause the dict cannot be 
found after configuration changed or migration.
{code}
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}


  was:
Absolute path is used in global dictionary, which may cause the dict cannot be 
found after configuration changed or migration.
{code}
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}



> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Yifei Wu
>
> Absolute path is used in global dictionary, which may cause the dict cannot 
> be found after configuration changed or migration.
> {code}
> {
>   "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
>   "last_modified" : 0,
>   "version" : "2.3.0.20500",
>   "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
>   "source_column" : "PRICE",
>   "source_column_index" : 6,
>   "data_type" : "decimal(19,4)",
>   "input" : {
> "path" : 
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
>   },
>   "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
>   "cardinality" : 8878
> }^@hdfs://master:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/resources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yifei Wu updated KYLIN-2945:

Description: 
Absolute path is used in global dictionary, which may cause the dict cannot be 
found after configuration changed or migration.
{code}
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}


  was:
Absolute path is used in global dictionary, which may cause the dict cannot be 
found after configuration changed or migration.
{code}
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}



> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Yifei Wu
>
> Absolute path is used in global dictionary, which may cause the dict cannot 
> be found after configuration changed or migration.
> {code}
> {
>   "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
>   "last_modified" : 0,
>   "version" : "2.3.0.20500",
>   "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
>   "source_column" : "PRICE",
>   "source_column_index" : 6,
>   "data_type" : "decimal(19,4)",
>   "input" : {
> "path" : 
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_default/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
>   },
>   "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
>   "cardinality" : 8878
> }^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yifei Wu updated KYLIN-2945:

Description: 
Absolute path is used in global dictionary, which may cause the dict cannot be 
found after configuration changed or migration.
{code}
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}


  was:
Absolute path is used in global dictionary, which may cause the dict cannot be 
found when configuration changed or migration.
{code}
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}



> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Yifei Wu
>
> Absolute path is used in global dictionary, which may cause the dict cannot 
> be found after configuration changed or migration.
> {code}
> {
>   "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
>   "last_modified" : 0,
>   "version" : "2.3.0.20500",
>   "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
>   "source_column" : "PRICE",
>   "source_column_index" : 6,
>   "data_type" : "decimal(19,4)",
>   "input" : {
> "path" : 
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
>   },
>   "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
>   "cardinality" : 8878
> }^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yifei Wu updated KYLIN-2945:

Description: 
Absolute path is used in global dictionary, which may cause the dict cannot be 
found when configuration changed or migration.
{code}
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}


  was:
Absolute path is used in global dictionary, which may cause the dict cannot be 
found when configuration changed or migration.
{code:json}
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}



> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Yifei Wu
>
> Absolute path is used in global dictionary, which may cause the dict cannot 
> be found when configuration changed or migration.
> {code}
> {
>   "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
>   "last_modified" : 0,
>   "version" : "2.3.0.20500",
>   "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
>   "source_column" : "PRICE",
>   "source_column_index" : 6,
>   "data_type" : "decimal(19,4)",
>   "input" : {
> "path" : 
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
>   },
>   "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
>   "cardinality" : 8878
> }^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yifei Wu updated KYLIN-2945:

Description: 
Absolute path is used in global dictionary, which may cause the dict cannot be 
found when configuration changed or migration.
{code:json}
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
{code}


  was:
Absolute path is used in global dictionary, which may cause the dict cannot be 
found when configuration changed or migration.
```
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
```



> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Yifei Wu
>
> Absolute path is used in global dictionary, which may cause the dict cannot 
> be found when configuration changed or migration.
> {code:json}
> {
>   "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
>   "last_modified" : 0,
>   "version" : "2.3.0.20500",
>   "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
>   "source_column" : "PRICE",
>   "source_column_index" : 6,
>   "data_type" : "decimal(19,4)",
>   "input" : {
> "path" : 
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
>   },
>   "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
>   "cardinality" : 8878
> }^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yifei Wu updated KYLIN-2945:

Description: 
Absolute path is used in global dictionary, which may cause the dict cannot be 
found when configuration changed or migration.
...
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
...


  was:Absolute path is used in global dictionary, which may cause issue when 
cinfiguration changed


> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Yifei Wu
>
> Absolute path is used in global dictionary, which may cause the dict cannot 
> be found when configuration changed or migration.
> ...
> {
>   "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
>   "last_modified" : 0,
>   "version" : "2.3.0.20500",
>   "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
>   "source_column" : "PRICE",
>   "source_column_index" : 6,
>   "data_type" : "decimal(19,4)",
>   "input" : {
> "path" : 
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
>   },
>   "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
>   "cardinality" : 8878
> }^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> ...



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yifei Wu updated KYLIN-2945:

Description: 
Absolute path is used in global dictionary, which may cause the dict cannot be 
found when configuration changed or migration.
```
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
```


  was:
Absolute path is used in global dictionary, which may cause the dict cannot be 
found when configuration changed or migration.
...
{
  "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
  "last_modified" : 0,
  "version" : "2.3.0.20500",
  "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
  "source_column" : "PRICE",
  "source_column_index" : 6,
  "data_type" : "decimal(19,4)",
  "input" : {
"path" : 
"hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
"size" : 81150,
"last_modified_time" : 1508133611074
  },
  "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
  "cardinality" : 8878
}^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
...



> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Yifei Wu
>
> Absolute path is used in global dictionary, which may cause the dict cannot 
> be found when configuration changed or migration.
> ```
> {
>   "uuid" : "b82505d8-5b40-4009-8839-8456500ea6a8",
>   "last_modified" : 0,
>   "version" : "2.3.0.20500",
>   "source_table" : "KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES",
>   "source_column" : "PRICE",
>   "source_column_index" : 6,
>   "data_type" : "decimal(19,4)",
>   "input" : {
> "path" : 
> "hdfs://sandbox.hortonworks.com:8020/kylin/kylin_yifei_1011_testGlobalDictMigration/kylin-d213a963-b5e3-4e75-a1a2-8af93ca83a80/global_dict_cube/fact_distinct_columns/KYLIN_SALES.PRICE",
> "size" : 81150,
> "last_modified_time" : 1508133611074
>   },
>   "dictionary_class" : "org.apache.kylin.dict.AppendTrieDictionary",
>   "cardinality" : 8878
> }^@Uresources/GlobalDict/dict/KYLIN_YIFEI_1011_TESTGLOBALDICTMIGRATION.KYLIN_SALES/PRICE/
> ```



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yifei Wu updated KYLIN-2945:

Issue Type: Improvement  (was: Bug)

> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Improvement
>Reporter: Yifei Wu
>
> Absolute path is used in global dictionary, which may cause issue when 
> cinfiguration changed



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yifei Wu updated KYLIN-2945:

Description: Absolute path is used in global dictionary, which may cause 
issue when cinfiguration changed  (was: absolute path is used in dictionary and 
snapshot which will cause reusing issue when migrating)

> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>
> Absolute path is used in global dictionary, which may cause issue when 
> cinfiguration changed



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yifei Wu updated KYLIN-2945:

Description: absolute path is used in dictionary and snapshot which will 
cause reusing issue when migrating

> global dict specific info use absolute path when saved it
> -
>
> Key: KYLIN-2945
> URL: https://issues.apache.org/jira/browse/KYLIN-2945
> Project: Kylin
>  Issue Type: Bug
>Reporter: Yifei Wu
>
> absolute path is used in dictionary and snapshot which will cause reusing 
> issue when migrating



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (KYLIN-2945) global dict specific info use absolute path when saved it

2017-10-18 Thread Yifei Wu (JIRA)
Yifei Wu created KYLIN-2945:
---

 Summary: global dict specific info use absolute path when saved it
 Key: KYLIN-2945
 URL: https://issues.apache.org/jira/browse/KYLIN-2945
 Project: Kylin
  Issue Type: Bug
Reporter: Yifei Wu






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Updated] (KYLIN-2847) avoid doing useless work by checking query deadline

2017-10-18 Thread Dayue Gao (JIRA)

 [ 
https://issues.apache.org/jira/browse/KYLIN-2847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dayue Gao updated KYLIN-2847:
-
Attachment: KYLIN-2847.patch.1

patch updated, make "deadline" a local variable of CubeVisitService.

> avoid doing useless work by checking query deadline
> ---
>
> Key: KYLIN-2847
> URL: https://issues.apache.org/jira/browse/KYLIN-2847
> Project: Kylin
>  Issue Type: Improvement
>  Components: Query Engine, Storage - HBase
>Affects Versions: v2.1.0
>Reporter: Dayue Gao
>Assignee: Dayue Gao
>  Labels: scope
> Attachments: KYLIN-2847.patch, KYLIN-2847.patch.1
>
>
> Under high load, requests can spend a long time waiting in RPC queue, 
> probably longer than query timeout. However, current coprocessor timeout 
> mechanism doesn't take RPC queue time into account. As a result, handling 
> these requests not only waste server resources while doing nothing useful, 
> but can also cause cascading failure when server crashes and client retries.
> To recover from server overload ASAP, we should check query deadline at each 
> stages of query processing, and avoid spending resources on query that will 
> exceed their deadline.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)