[
https://issues.apache.org/jira/browse/KYLIN-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928282#comment-17928282
]
Guoliang Sun commented on KYLIN-6016:
-------------------------------------
h3. Root Cause
The `gluten.jar` under `spark/jars` contains shaded modified third-party
classes that conflict with the native classes in Spark.
Previously, the Gluten team temporarily bypassed the class conflict issue, but
during the build process, a new Spark application is launched, and the class
loading order may not proceed as expected, causing conflicts.
h3. Dev Design
Since Gluten is not required during the build process, the `gluten.jar` can be
removed from `spark/jars`.
Meanwhile, the `gluten.jar` used by Kylin Sparder is expected to prioritize
loading from `lib/ext/gluten.jar`, so there is no conflict between the two.
> Kylin5 occasionally encounters ParquetFileFormat class conflicts during builds
> ------------------------------------------------------------------------------
>
> Key: KYLIN-6016
> URL: https://issues.apache.org/jira/browse/KYLIN-6016
> Project: Kylin
> Issue Type: Bug
> Affects Versions: 5.0.0
> Reporter: Guoliang Sun
> Priority: Major
> Attachments: image-2025-02-19-14-42-54-238.png
>
>
> !image-2025-02-19-14-42-54-238.png|width=549,height=232!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
