[
https://issues.apache.org/jira/browse/KYLIN-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxiaojing updated KYLIN-4366:
--------------------------------
Description:
Merge the global dict values of each column calculated by previous parallel
total build step into the global dictionary table (default
globalDictDatabase.cubeName_global_dict) of this cube.
HQL example below:
{code:java}
//Add partition if not exists
ALTER TABLE
kylin_intermediate_kylin_sales_cube_mr_6222c210_ce2d_e8ce_dd0f_f12c38fa9115_global_dict
add IF NOT EXISTS partition (dict_column='KYLIN_SALES_SELLER_ID');
ALTER TABLE
kylin_intermediate_kylin_sales_cube_mr_6222c210_ce2d_e8ce_dd0f_f12c38fa9115_global_dict
add IF NOT EXISTS partition (dict_column='KYLIN_SALES_BUYER_ID');
//merge data
INSERT OVERWRITE TABLE db.kylin_sales_cube_mr_global_dict PARTITION
(dict_column = 'KYLIN_SALES_SELLER_ID')
SELECT dict_key, dict_val FROM db.kylin_sales_cube_mr_global_dict WHERE
dict_column = 'KYLIN_SALES_SELLER_ID'
UNION
SELECT dict_key, dict_val FROM
kylin_intermediate_kylin_sales_cube_mr_6222c210_ce2d_e8ce_dd0f_f12c38fa9115_global_dict
WHERE dict_column = 'KYLIN_SALES_SELLER_ID' ;
INSERT OVERWRITE TABLE db.kylin_sales_cube_mr_global_dict PARTITION
(dict_column = 'KYLIN_SALES_BUYER_ID')
SELECT dict_key, dict_val FROM db.kylin_sales_cube_mr_global_dict WHERE
dict_column = 'KYLIN_SALES_BUYER_ID'
UNION
SELECT dict_key, dict_val FROM
kylin_intermediate_kylin_sales_cube_mr_6222c210_ce2d_e8ce_dd0f_f12c38fa9115_global_dict
WHERE dict_column = 'KYLIN_SALES_BUYER_ID' ;
{code}
was:Merge the global dict values of each column calculated by previous
parallel total build step into the global dictionary table (default
globalDictDatabase.cubeName_global_dict) of this cube
> Build Global Dict by MR/Hive, Merge to dict table Step implementation
> ---------------------------------------------------------------------
>
> Key: KYLIN-4366
> URL: https://issues.apache.org/jira/browse/KYLIN-4366
> Project: Kylin
> Issue Type: Sub-task
> Reporter: wangxiaojing
> Assignee: wangxiaojing
> Priority: Major
>
> Merge the global dict values of each column calculated by previous parallel
> total build step into the global dictionary table (default
> globalDictDatabase.cubeName_global_dict) of this cube.
> HQL example below:
> {code:java}
> //Add partition if not exists
> ALTER TABLE
> kylin_intermediate_kylin_sales_cube_mr_6222c210_ce2d_e8ce_dd0f_f12c38fa9115_global_dict
> add IF NOT EXISTS partition (dict_column='KYLIN_SALES_SELLER_ID');
> ALTER TABLE
> kylin_intermediate_kylin_sales_cube_mr_6222c210_ce2d_e8ce_dd0f_f12c38fa9115_global_dict
> add IF NOT EXISTS partition (dict_column='KYLIN_SALES_BUYER_ID');
> //merge data
> INSERT OVERWRITE TABLE db.kylin_sales_cube_mr_global_dict PARTITION
> (dict_column = 'KYLIN_SALES_SELLER_ID')
> SELECT dict_key, dict_val FROM db.kylin_sales_cube_mr_global_dict WHERE
> dict_column = 'KYLIN_SALES_SELLER_ID'
> UNION
> SELECT dict_key, dict_val FROM
> kylin_intermediate_kylin_sales_cube_mr_6222c210_ce2d_e8ce_dd0f_f12c38fa9115_global_dict
> WHERE dict_column = 'KYLIN_SALES_SELLER_ID' ;
> INSERT OVERWRITE TABLE db.kylin_sales_cube_mr_global_dict PARTITION
> (dict_column = 'KYLIN_SALES_BUYER_ID')
> SELECT dict_key, dict_val FROM db.kylin_sales_cube_mr_global_dict WHERE
> dict_column = 'KYLIN_SALES_BUYER_ID'
> UNION
> SELECT dict_key, dict_val FROM
> kylin_intermediate_kylin_sales_cube_mr_6222c210_ce2d_e8ce_dd0f_f12c38fa9115_global_dict
> WHERE dict_column = 'KYLIN_SALES_BUYER_ID' ;
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
