[
https://issues.apache.org/jira/browse/KYLIN-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17410401#comment-17410401
]
mukvin commented on KYLIN-5083:
-------------------------------
Root Cause
# docker for kylin4 start sparder by default.
# spark-jars need to be upload to path of
kylin.query.spark-conf.spark.yarn.jars(in kylin.propertis)
# if hadoop service is not available, hdfs://spark2_jars will not created
properly in code (/kylin/docker/dockerfile/standalone/entrypoint.sh)
{code:java}
...
if [ ! -f "/home/admin/first_run" ]
then
hdfs dfs -mkdir -p /kylin4/spark-history
hdfs dfs -mkdir -p /spark2_jars
hdfs dfs -put -f $SPARK_HOME/jars/* hdfs://localhost:9000/spark2_jars/
fi
...{code}
> Docker for kylin4 need to check hadoop service before start kylin
> -----------------------------------------------------------------
>
> Key: KYLIN-5083
> URL: https://issues.apache.org/jira/browse/KYLIN-5083
> Project: Kylin
> Issue Type: Bug
> Affects Versions: v4.0.0
> Reporter: mukvin
> Assignee: mukvin
> Priority: Minor
> Fix For: v4.0.1
>
> Attachments: image-2021-09-06-14-39-35-447.png,
> image-2021-09-06-14-43-00-822.png
>
>
> When start docker of kylin4, someone will found that error in
> $KYLIN_HOME/logs/kylin.log as followed:
> # kylin webui can't open
> # hdfs://spark2_jars not created. In kylin.properties,
> kylin.query.spark-conf.spark.yarn.jars is set to
> hdfs://localhost:9000/spar2_jars/*.
> !image-2021-09-06-14-39-35-447.png|width=411,height=176!
> !image-2021-09-06-14-43-00-822.png|width=409,height=107!
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)