[
https://issues.apache.org/jira/browse/SPARK-42370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhiguo Wu updated SPARK-42370:
------------------------------
Description:
When I run `./sbin/start-history-server.sh`
I'll get the error below
!image-2023-02-07-16-54-43-593.png!
Although we already use org.openlabtesting.leveldbjni on aarch64, which can
works on aarch64,
we still load org.fusesource.hawtjni.runtime.Library on wrong jar file
When we run `export SPARK_DAEMON_JAVA_OPTS=-verbose:class`, we can see the
class is loaded from jline-2.14.6.jar where the correct class file is under
leveldbjni-all-1.8.jar
Incorrect(now):
[Loaded org.fusesource.hawtjni.runtime.Library from
file:/yourdir/spark/jars/jline-2.14.6.jar]
Correct(expected):
[Loaded org.fusesource.hawtjni.runtime.Library from
file:/yourdir/spark/jars/leveldbjni-all-1.8.jar]
was:
When I run `./sbin/start-history-server.sh`
I'll get the error below
!image-2023-02-07-16-54-43-593.png!
Although we already use org.openlabtesting.leveldbjni on aarch64, which can
works on aarch64,
we still load org.fusesource.hawtjni.runtime.Library on wrong jar file
we can see the class is load from jline-2.14.6.jar where the correct class file
is under leveldbjni-all-1.8.jar when we run export
SPARK_DAEMON_JAVA_OPTS=-verbose:class
Incorrect:
[Loaded org.fusesource.hawtjni.runtime.Library from
file:/yourdir/spark/jars/jline-2.14.6.jar]
Correct:
[Loaded org.fusesource.hawtjni.runtime.Library from
file:/yourdir/spark/jars/leveldbjni-all-1.8.jar]
> Spark History Server fails to start on CentOS7 aarch64
> ------------------------------------------------------
>
> Key: SPARK-42370
> URL: https://issues.apache.org/jira/browse/SPARK-42370
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 3.2.3
> Reporter: Zhiguo Wu
> Priority: Major
> Attachments: image-2023-02-07-16-54-43-593.png
>
>
> When I run `./sbin/start-history-server.sh`
> I'll get the error below
> !image-2023-02-07-16-54-43-593.png!
>
> Although we already use org.openlabtesting.leveldbjni on aarch64, which can
> works on aarch64,
> we still load org.fusesource.hawtjni.runtime.Library on wrong jar file
> When we run `export SPARK_DAEMON_JAVA_OPTS=-verbose:class`, we can see the
> class is loaded from jline-2.14.6.jar where the correct class file is under
> leveldbjni-all-1.8.jar
>
> Incorrect(now):
> [Loaded org.fusesource.hawtjni.runtime.Library from
> file:/yourdir/spark/jars/jline-2.14.6.jar]
> Correct(expected):
> [Loaded org.fusesource.hawtjni.runtime.Library from
> file:/yourdir/spark/jars/leveldbjni-all-1.8.jar]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
