Zhiguo Wu created SPARK-42370:
---------------------------------

             Summary: Spark History Server fails to start on CentOS7 aarch64
                 Key: SPARK-42370
                 URL: https://issues.apache.org/jira/browse/SPARK-42370
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 3.2.3
            Reporter: Zhiguo Wu
         Attachments: image-2023-02-07-16-54-43-593.png

When I run `./sbin/start-history-server.sh`

I'll get the error below

!image-2023-02-07-16-46-07-451.png!

 

Although we already use org.openlabtesting.leveldbjni on aarch64, which can 
works on aarch64,

we still load org.fusesource.hawtjni.runtime.Library on wrong jar file

we can see the class is load from jline-2.14.6.jar where the correct class file 
is under leveldbjni-all-1.8.jar when we run export 
SPARK_DAEMON_JAVA_OPTS=-verbose:class

 

Incorrect:

[Loaded org.fusesource.hawtjni.runtime.Library from 
file:/yourdir/spark/jars/jline-2.14.6.jar] 

Correct:

[Loaded org.fusesource.hawtjni.runtime.Library from 
file:/yourdir/spark/jars/leveldbjni-all-1.8.jar] 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to