[
https://issues.apache.org/jira/browse/KYLIN-2371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shaofeng SHI updated KYLIN-2371:
--------------------------------
Description:
If user wants to customize some conf parameter for some cubes, he can define
the conf with prefix "kylin.engine.spark-conf." in either
"conf/kylin.properties" or at the project/cube level, e.g,
kylin.engine.spark-conf.spark.executor.instances=4
Then kylin will parse and apply the conf when submitting to spark, Kylin will
run:
"spark/bin/spark-submit --conf spark.executor.instances=4 ..."
was:
If user wants to customize some conf parameter for some cubes, he can define
the conf with prefix "kylin.engine.spark.config-override." , e.g,
kylin.engine.spark.config-override.spark.executor.instances=4
Then kylin will parse and apply the conf when submitting to spark:
spark-submit --conf spark.executor.instances=4 ...
> Allow overwrite default spark conf at cube level
> ------------------------------------------------
>
> Key: KYLIN-2371
> URL: https://issues.apache.org/jira/browse/KYLIN-2371
> Project: Kylin
> Issue Type: Sub-task
> Components: Spark Engine
> Reporter: Shaofeng SHI
> Assignee: Shaofeng SHI
> Priority: Minor
> Fix For: v2.0.0
>
>
> If user wants to customize some conf parameter for some cubes, he can define
> the conf with prefix "kylin.engine.spark-conf." in either
> "conf/kylin.properties" or at the project/cube level, e.g,
> kylin.engine.spark-conf.spark.executor.instances=4
> Then kylin will parse and apply the conf when submitting to spark, Kylin will
> run:
> "spark/bin/spark-submit --conf spark.executor.instances=4 ..."
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
