[
https://issues.apache.org/jira/browse/KYLIN-5126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17444240#comment-17444240
]
xbchao commented on KYLIN-5126:
-------------------------------
i don't understand why the spark command is --conf 'spark.master=local', but i
set spark.master=yarn, and the kylin.properties is:
## Spark conf (default is in spark/conf/spark-defaults.conf)
kylin.engine.spark-conf.spark.master=yarn
kylin.engine.spark-conf.spark.submit.deployMode=cluster
kylin.engine.spark-conf.spark.yarn.queue=default
kylin.engine.spark-conf.spark.executor.cores=2
kylin.engine.spark-conf.spark.executor.memory=4G
kylin.engine.spark-conf.spark.executor.instances=4
kylin.engine.spark-conf.spark.executor.memoryOverhead=2G
kylin.engine.spark-conf.spark.driver.cores=2
kylin.engine.spark-conf.spark.driver.memory=4G
kylin.engine.spark-conf.spark.driver.memoryOverhead=2G
kylin.engine.spark-conf.spark.shuffle.service.enabled=true
thank your very much！
> Build kylin 4.0, spark has not been able to submit to the yarn cluster
> ----------------------------------------------------------------------
>
> Key: KYLIN-5126
> URL: https://issues.apache.org/jira/browse/KYLIN-5126
> Project: Kylin
> Issue Type: Bug
> Reporter: xbchao
> Priority: Major
>
> When I built kylin 4.0, spark could not be submitted to the yarn cluster. The
> version used was apache-kylin-4.0.0-bin-spark2, which was deployed in the aws
> emr server.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
