[
https://issues.apache.org/jira/browse/KYLIN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17055654#comment-17055654
]
Harvey Yue commented on KYLIN-3904:
-----------------------------------
Add "-C file://%s" parameter to flink run command.
flink run -m yarn-cluster -ytm 4G -yjm 2G -yD taskmanager.memory.preallocate
false -ys 1 -C
file:///opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/jars/hbase-server-2.1.0-cdh6.2.0.jar
-C
file:///opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/jars/hbase-shaded-protobuf-2.1.0.jar
-C
file:///opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/jars/hbase-metrics-2.1.0-cdh6.2.0.jar
-C
file:///opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/jars/hbase-metrics-api-2.1.0-cdh6.2.0.jar
-C file:///opt/kylin/tomcat/webapps/kylin/WEB-INF/lib/metrics-core-2.2.0.jar
-C
file:///opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/jars/hbase-protocol-2.1.0-cdh6.2.0.jar
-C
file:///opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/jars/hbase-protocol-shaded-2.1.0-cdh6.2.0.jar
-C
file:///opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/jars/hbase-mapreduce-2.1.0-cdh6.2.0.jar
-C file:///opt/spark-2.4.4-bin-hadoop2.7/jars/htrace-core-3.1.0-incubating.jar
-C
file:///opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/jars/hbase-common-2.1.0-cdh6.2.0.jar
-C
file:///opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/jars/hbase-shaded-miscellaneous-2.1.0.jar
-C
file:///opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/jars/hbase-hadoop-compat-2.1.0-cdh6.2.0.jar
-C
file:///opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/jars/hbase-hadoop2-compat-2.1.0-cdh6.2.0.jar
-C
file:///opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/jars/hbase-client-2.1.0-cdh6.2.0.jar
-c org.apache.kylin.common.util.FlinkEntry -p 8
/opt/kylin/lib/kylin-job-3.0.1.jar -className
org.apache.kylin.storage.hbase.steps.FlinkCubeHFile -output
hdfs://ng-dc-master:8020/kylin/kylin_metadata/kylin-51cc6449-15dd-b81f-940f-23a9cd95bd2e/mileage_cube/hfile
-partitions
hdfs://ng-dc-master:8020/kylin/kylin_metadata/kylin-51cc6449-15dd-b81f-940f-23a9cd95bd2e/mileage_cube/rowkey_stats/part-r-00000_hfile
-input
hdfs://ng-dc-master:8020/kylin/kylin_metadata/kylin-51cc6449-15dd-b81f-940f-23a9cd95bd2e/mileage_cube/cuboid/level_6_cuboid
-enableObjectReuse false -segmentId 66eb63d4-b2dd-1d37-62a6-9abc6f6e1e01
-metaUrl
kylin_metadata@hdfs,path=hdfs://ng-dc-master:8020/kylin/kylin_metadata/kylin-51cc6449-15dd-b81f-940f-23a9cd95bd2e/mileage_cube/metadata
-cubename mileage_cube -hbaseConfPath
hdfs://ng-dc-master:8020/kylin/kylin_metadata/kylin-51cc6449-15dd-b81f-940f-23a9cd95bd2e/hbase-conf.xml
> Support more dependency jars in FlinkExecutable for FlinkCubeHFile
> ------------------------------------------------------------------
>
> Key: KYLIN-3904
> URL: https://issues.apache.org/jira/browse/KYLIN-3904
> Project: Kylin
> Issue Type: Sub-task
> Components: Flink Engine
> Reporter: vinoyang
> Assignee: Harvey Yue
> Priority: Major
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
