[jira] [Commented] (KYLIN-4489) Create a tool for migration cross clusters

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/KYLIN-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135359#comment-17135359
 ] 

ASF subversion and git services commented on KYLIN-4489:


Commit 2e2a4dff9ca9c08351084f53d293e189083db140 in kylin's branch 
refs/heads/master from Zhong, Yanghong
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=2e2a4df ]

KYLIN-4489 Create a tool for migration cross clusters


> Create a tool for migration cross clusters
> --
>
> Key: KYLIN-4489
> URL: https://issues.apache.org/jira/browse/KYLIN-4489
> Project: Kylin
>  Issue Type: Sub-task
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (KYLIN-4489) Create a tool for migration cross clusters

[ASF subversion and git services (Jira)]

[ 
https://issues.apache.org/jira/browse/KYLIN-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135357#comment-17135357
 ] 

ASF subversion and git services commented on KYLIN-4489:


Commit d502c52ae3198c0bad39bde9dd3e244b67b95520 in kylin's branch 
refs/heads/master from Zhong, Yanghong
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=d502c52 ]

KYLIN-4489 Add hive table compatibility check rest service


> Create a tool for migration cross clusters
> --
>
> Key: KYLIN-4489
> URL: https://issues.apache.org/jira/browse/KYLIN-4489
> Project: Kylin
>  Issue Type: Sub-task
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (KYLIN-4489) Create a tool for migration cross clusters

[Zhichao Zhang (Jira)]

[ 
https://issues.apache.org/jira/browse/KYLIN-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17133027#comment-17133027
 ] 

Zhichao  Zhang commented on KYLIN-4489:
---

Added the parameters description for CubeMigrationCrossClusterCLI:
 * kylinUriSrc: specify the source kylin uri with format user:pwd@host:port, 
it's required;
 * kylinUriDst: specify the target kylin uri with format user:pwd@host:port, 
it's required;
 * updateMappingPath: specify the path for the update Hive table mapping file, 
the format is json, see the example below:

{code:java}
{ "KYLIN_4485_QA.KYLIN_ACCOUNT": { "database": "KYLIN_4485_PROD", "tableName": 
"KYLIN_ACCOUNT" }, "KYLIN_4485_QA.KYLIN_CAL_DT": { "database": 
"KYLIN_4485_PROD" }, "KYLIN_4485_QA.KYLIN_CATEGORY_GROUPINGS": { "database": 
"KYLIN_4485_PROD" }, "KYLIN_4485_QA.KYLIN_COUNTRY": { "database": 
"KYLIN_4485_PROD" }, "KYLIN_4485_QA.KYLIN_SALES": { "database": 
"KYLIN_4485_PROD" } }{code}
 * cube: specify the cubes which you want to migrate, separated by ',';
 * hybrid: specify the hybrids which you want to migrate, separated by ',';
 * project: specify the projects which you want to migrate, separated by ',';
 * all: specify all projects to migrate;

*Note*: You must add only one of above four parameters;
 * dstHiveCheck: specify whether to check target hive tables, the default value 
is true;
 * overwrite: specify whether to overwrite existing cubes, the default value is 
false;
 * schemaOnly: specify whether only migrate cube related schema, the default 
value is true;
 * execute: specify whether it's to execute the migration, the default value is 
false;
 * coprocessorPath: specify the path of coprocessor to be deployed, the default 
value is get from KylinConfigBase.getCoprocessorLocalJar();
 * codeOfFSHAEnabled: specify whether to enable the namenode ha of clusters;
 * distCpJobQueue: specify the mapreduce.job.queuename for DistCp job;
 * distCpJobMemory: specify the mapreduce.map.memory.mb for DistCp job;
 * nThread: specify the number of threads for migrating cube data in parallel;

> Create a tool for migration cross clusters
> --
>
> Key: KYLIN-4489
> URL: https://issues.apache.org/jira/browse/KYLIN-4489
> Project: Kylin
>  Issue Type: Sub-task
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Commented] (KYLIN-4489) Create a tool for migration cross clusters

[Zhong Yanghong (Jira)]

[ 
https://issues.apache.org/jira/browse/KYLIN-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111855#comment-17111855
 ] 

Zhong Yanghong commented on KYLIN-4489:
---

One sample command is:

{code}

${KYLIN_HOME}/bin/kylin.sh 
org.apache.kylin.tool.migration.CubeMigrationCrossClusterCLI -kylinUriSrc 
ADMIN:ky...@sandbox.hortonworks.com:7070 -kylinUriDst 
ADMIN:ky...@jenkins4-3-4122655.lvs02.dev.ebayc3.com:7070 -cube 
ci_inner_join_cube -dstHiveCheck false -execute true -schemaOnly false 
-overwrite true

{code}

> Create a tool for migration cross clusters
> --
>
> Key: KYLIN-4489
> URL: https://issues.apache.org/jira/browse/KYLIN-4489
> Project: Kylin
>  Issue Type: Sub-task
>Reporter: Zhong Yanghong
>Assignee: Zhong Yanghong
>Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)