[
https://issues.apache.org/jira/browse/KYLIN-5273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
penney resolved KYLIN-5273.
----------------------------
Fix Version/s: v4.0.1
Reviewers: mukvin
Resolution: Fixed
I changed the Spark version to 3.1.1 and it succeeded,But first, I must ensure
that Spark can be connected to Hive normally.That is to say, Spark SQL can be
used normally, which makes me change many HDP configurations.
step1:download spark3.1.1-hadoop3.1
step2:modify spark-defaults.conf add spark.driver.extraJavaOptions
-Dhdp.version=3.1.4.0-315
spark.yarn.am.extraJavaOptions -Dhdp.version=3.1.4.0-315
modify other config to connect to your hive
step3: upload spark all libs to hdfs and modify spark-defaults.conf: set the
spark.yarn.jars hdfs:///some/*.jar
spark.yarn.archive=hdfs:///some/spark-libs.jar
step4:copy commons-collections-3.2.2.jar commons-configuration-1.3.jar to the
${kylin_home}/tomcat/webapps/kylin/WEB-INF/lib
step5:modify kylin.properties to connect to mysql,you maybe need to copy
mysql-connector.jar to ${kylin_home}/ext
That's all,good luck to you
> kylin4.0.1部署启动不了
> ----------------
>
> Key: KYLIN-5273
> URL: https://issues.apache.org/jira/browse/KYLIN-5273
> Project: Kylin
> Issue Type: Bug
> Components: Environment
> Affects Versions: v4.0.1
> Environment: HDP-3.1.4,Ambari-2.7.4
> Reporter: penney
> Priority: Major
> Fix For: v4.0.1
>
> Attachments: Snipaste_2022-09-30_16-05-49.png,
> image-2022-09-30-16-18-25-051.png
>
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> 我之前用的是3.1.2的kylin版本,底层引擎用的是mr正常运行没问题。最近想换成新发布的版本4.0.1,而且按照官网部署步骤进行操作,ui界面能看到,就是获取不了hive表信息,查看
--
This message was sent by Atlassian Jira
(v8.20.10#820010)