[ 
https://issues.apache.org/jira/browse/KYLIN-5083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17410401#comment-17410401
 ] 

mukvin commented on KYLIN-5083:
-------------------------------

Root Cause
 # docker for kylin4 start sparder by default.
 # spark-jars need to be upload to path of 
kylin.query.spark-conf.spark.yarn.jars(in kylin.propertis)
 # if hadoop service is not available, hdfs://spark2_jars will not created 
properly in code (/kylin/docker/dockerfile/standalone/entrypoint.sh)

{code:java}
...
if [ ! -f "/home/admin/first_run" ]
then
    hdfs dfs -mkdir -p /kylin4/spark-history
    hdfs dfs -mkdir -p /spark2_jars
    hdfs dfs -put -f $SPARK_HOME/jars/* hdfs://localhost:9000/spark2_jars/
fi
...{code}

> Docker for kylin4 need to check hadoop service before start kylin
> -----------------------------------------------------------------
>
>                 Key: KYLIN-5083
>                 URL: https://issues.apache.org/jira/browse/KYLIN-5083
>             Project: Kylin
>          Issue Type: Bug
>    Affects Versions: v4.0.0
>            Reporter: mukvin
>            Assignee: mukvin
>            Priority: Minor
>             Fix For: v4.0.1
>
>         Attachments: image-2021-09-06-14-39-35-447.png, 
> image-2021-09-06-14-43-00-822.png
>
>
> When start docker of kylin4, someone will found that error in 
> $KYLIN_HOME/logs/kylin.log as followed:
>  # kylin webui can't open
>  # hdfs://spark2_jars not created. In kylin.properties, 
> kylin.query.spark-conf.spark.yarn.jars is set to 
> hdfs://localhost:9000/spar2_jars/*.
> !image-2021-09-06-14-39-35-447.png|width=411,height=176!
> !image-2021-09-06-14-43-00-822.png|width=409,height=107!
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to