[
https://issues.apache.org/jira/browse/KYLIN-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17930212#comment-17930212
]
Guoliang Sun commented on KYLIN-6066:
-------------------------------------
h3. Root Cause
1. There is a minor issue with fetching YARN resource info. According to the
current design, there are three attempts in total, and an exception is thrown
only if the third attempt fails. However, the first attempt to fetch YARN info
is not wrapped in a try-catch block. If an exception occurs during the first
attempt, it fails immediately, and the remaining two attempts are not executed.
2. The `gluten.jar` is missing from the classpath, causing a
`ClassNotFoundException` during `spark-submit`.
3. In `spark-test`, the Spark SQL tests use the constructed `SparkConf`, which
by default does not include `extraClassPath`, leading to the same issue of
Gluten classes not being found.
> Error in "Checking Spark Availability"
> --------------------------------------
>
> Key: KYLIN-6066
> URL: https://issues.apache.org/jira/browse/KYLIN-6066
> Project: Kylin
> Issue Type: Bug
> Affects Versions: 5.0.0
> Reporter: Guoliang Sun
> Assignee: Guoliang Sun
> Priority: Major
> Fix For: 5.0.2
>
>
> 1. Standalone Mode: Checking Spark Availability fails when Kylin starts.
> 2. YARN Mode: Checking Spark Availability is skipped.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
