[ 
https://issues.apache.org/jira/browse/KYLIN-5273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

penney  resolved KYLIN-5273.
----------------------------
    Fix Version/s: v4.0.1
        Reviewers: mukvin
       Resolution: Fixed

I changed the Spark version to 3.1.1 and it succeeded,But first, I must ensure 
that Spark can be connected to Hive normally.That is to say, Spark SQL can be 
used normally, which makes me change many HDP configurations. 

step1:download spark3.1.1-hadoop3.1

step2:modify spark-defaults.conf add spark.driver.extraJavaOptions 
-Dhdp.version=3.1.4.0-315
spark.yarn.am.extraJavaOptions -Dhdp.version=3.1.4.0-315 

modify other config to connect to your hive

step3: upload spark all libs to hdfs and modify spark-defaults.conf: set the 
spark.yarn.jars hdfs:///some/*.jar
spark.yarn.archive=hdfs:///some/spark-libs.jar

step4:copy commons-collections-3.2.2.jar  commons-configuration-1.3.jar to the 
${kylin_home}/tomcat/webapps/kylin/WEB-INF/lib

step5:modify kylin.properties to connect to mysql,you maybe need to copy 
mysql-connector.jar to ${kylin_home}/ext

 

That's all,good luck to you

> kylin4.0.1部署启动不了
> ----------------
>
>                 Key: KYLIN-5273
>                 URL: https://issues.apache.org/jira/browse/KYLIN-5273
>             Project: Kylin
>          Issue Type: Bug
>          Components: Environment 
>    Affects Versions: v4.0.1
>         Environment: HDP-3.1.4,Ambari-2.7.4
>            Reporter: penney 
>            Priority: Major
>             Fix For: v4.0.1
>
>         Attachments: Snipaste_2022-09-30_16-05-49.png, 
> image-2022-09-30-16-18-25-051.png
>
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> 我之前用的是3.1.2的kylin版本,底层引擎用的是mr正常运行没问题。最近想换成新发布的版本4.0.1,而且按照官网部署步骤进行操作,ui界面能看到,就是获取不了hive表信息,查看



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to