zhaoyajun2009 commented on issue #21688:
URL: https://github.com/apache/pulsar/issues/21688#issuecomment-1848361664
> Ah, please keep all the version 3.0.1
use the 3.0.0 version of pulsar and offload ,the error is as follows:
`2023-12-09T18:08:46,499+0800 [main] INFO
org.apache.bookkeeper.mledger.offload.OffloaderUtils - Found and loaded 2
offloaders
2023-12-09T18:08:46,977+0800 [main] WARN
org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library
for your platform... using builtin-java classes where applicable
2023-12-09T18:08:47,033+0800 [main] ERROR
org.apache.pulsar.broker.PulsarService - Failed to start Pulsar service:
java.lang.RuntimeException: java.lang.ClassNotFoundException: Class
org.apache.hadoop.hdfs.DistributedFileSystem not found
org.apache.pulsar.broker.PulsarServerException: java.lang.RuntimeException:
java.lang.ClassNotFoundException: Class
org.apache.hadoop.hdfs.DistributedFileSystem not found
at
org.apache.pulsar.broker.PulsarService.createManagedLedgerOffloader(PulsarService.java:1429)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
at
org.apache.pulsar.broker.PulsarService.start(PulsarService.java:781)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
at
org.apache.pulsar.PulsarStandalone.start(PulsarStandalone.java:349)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
at
org.apache.pulsar.PulsarStandaloneStarter.main(PulsarStandaloneStarter.java:141)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException:
Class org.apache.hadoop.hdfs.DistributedFileSystem not found
at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2693) ~[?:?]
at
org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3534) ~[?:?]
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3569) ~[?:?]
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:174)
~[?:?]
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3673) ~[?:?]
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3624)
~[?:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:557) ~[?:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:290) ~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.impl.FileSystemManagedLedgerOffloader.<init>(FileSystemManagedLedgerOffloader.java:109)
~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.impl.FileSystemManagedLedgerOffloader.create(FileSystemManagedLedgerOffloader.java:81)
~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.FileSystemLedgerOffloaderFactory.create(FileSystemLedgerOffloaderFactory.java:48)
~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.FileSystemLedgerOffloaderFactory.create(FileSystemLedgerOffloaderFactory.java:30)
~[?:?]
at
org.apache.bookkeeper.mledger.LedgerOffloaderFactory.create(LedgerOffloaderFactory.java:112)
~[org.apache.pulsar-managed-ledger-3.0.0.jar:3.0.0]
at
org.apache.pulsar.broker.PulsarService.createManagedLedgerOffloader(PulsarService.java:1409)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
... 3 more
Caused by: java.lang.ClassNotFoundException: Class
org.apache.hadoop.hdfs.DistributedFileSystem not found
at
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2597)
~[?:?]
at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2691) ~[?:?]
at
org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3534) ~[?:?]
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3569) ~[?:?]
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:174)
~[?:?]
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3673) ~[?:?]
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3624)
~[?:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:557) ~[?:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:290) ~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.impl.FileSystemManagedLedgerOffloader.<init>(FileSystemManagedLedgerOffloader.java:109)
~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.impl.FileSystemManagedLedgerOffloader.create(FileSystemManagedLedgerOffloader.java:81)
~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.FileSystemLedgerOffloaderFactory.create(FileSystemLedgerOffloaderFactory.java:48)
~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.FileSystemLedgerOffloaderFactory.create(FileSystemLedgerOffloaderFactory.java:30)
~[?:?]
at
org.apache.bookkeeper.mledger.LedgerOffloaderFactory.create(LedgerOffloaderFactory.java:112)
~[org.apache.pulsar-managed-ledger-3.0.0.jar:3.0.0]
at
org.apache.pulsar.broker.PulsarService.createManagedLedgerOffloader(PulsarService.java:1409)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
... 3 more
2023-12-09T18:08:47,048+0800 [main] ERROR
org.apache.pulsar.PulsarStandaloneStarter - Failed to start pulsar service.
org.apache.pulsar.broker.PulsarServerException:
org.apache.pulsar.broker.PulsarServerException: java.lang.RuntimeException:
java.lang.ClassNotFoundException: Class
org.apache.hadoop.hdfs.DistributedFileSystem not found
at
org.apache.pulsar.broker.PulsarService.start(PulsarService.java:920)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
at
org.apache.pulsar.PulsarStandalone.start(PulsarStandalone.java:349)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
at
org.apache.pulsar.PulsarStandaloneStarter.main(PulsarStandaloneStarter.java:141)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
Caused by: org.apache.pulsar.broker.PulsarServerException:
java.lang.RuntimeException: java.lang.ClassNotFoundException: Class
org.apache.hadoop.hdfs.DistributedFileSystem not found
at
org.apache.pulsar.broker.PulsarService.createManagedLedgerOffloader(PulsarService.java:1429)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
at
org.apache.pulsar.broker.PulsarService.start(PulsarService.java:781)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
... 2 more
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException:
Class org.apache.hadoop.hdfs.DistributedFileSystem not found
at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2693) ~[?:?]
at
org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3534) ~[?:?]
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3569) ~[?:?]
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:174)
~[?:?]
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3673) ~[?:?]
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3624)
~[?:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:557) ~[?:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:290) ~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.impl.FileSystemManagedLedgerOffloader.<init>(FileSystemManagedLedgerOffloader.java:109)
~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.impl.FileSystemManagedLedgerOffloader.create(FileSystemManagedLedgerOffloader.java:81)
~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.FileSystemLedgerOffloaderFactory.create(FileSystemLedgerOffloaderFactory.java:48)
~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.FileSystemLedgerOffloaderFactory.create(FileSystemLedgerOffloaderFactory.java:30)
~[?:?]
at
org.apache.bookkeeper.mledger.LedgerOffloaderFactory.create(LedgerOffloaderFactory.java:112)
~[org.apache.pulsar-managed-ledger-3.0.0.jar:3.0.0]
at
org.apache.pulsar.broker.PulsarService.createManagedLedgerOffloader(PulsarService.java:1409)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
at
org.apache.pulsar.broker.PulsarService.start(PulsarService.java:781)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
... 2 more
Caused by: java.lang.ClassNotFoundException: Class
org.apache.hadoop.hdfs.DistributedFileSystem not found
at
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2597)
~[?:?]
at
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2691) ~[?:?]
at
org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3534) ~[?:?]
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3569) ~[?:?]
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:174)
~[?:?]
at
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3673) ~[?:?]
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3624)
~[?:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:557) ~[?:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:290) ~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.impl.FileSystemManagedLedgerOffloader.<init>(FileSystemManagedLedgerOffloader.java:109)
~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.impl.FileSystemManagedLedgerOffloader.create(FileSystemManagedLedgerOffloader.java:81)
~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.FileSystemLedgerOffloaderFactory.create(FileSystemLedgerOffloaderFactory.java:48)
~[?:?]
at
org.apache.bookkeeper.mledger.offload.filesystem.FileSystemLedgerOffloaderFactory.create(FileSystemLedgerOffloaderFactory.java:30)
~[?:?]
at
org.apache.bookkeeper.mledger.LedgerOffloaderFactory.create(LedgerOffloaderFactory.java:112)
~[org.apache.pulsar-managed-ledger-3.0.0.jar:3.0.0]
at
org.apache.pulsar.broker.PulsarService.createManagedLedgerOffloader(PulsarService.java:1409)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
at
org.apache.pulsar.broker.PulsarService.start(PulsarService.java:781)
~[org.apache.pulsar-pulsar-broker-3.0.0.jar:3.0.0]
... 2 more
2023-12-09T18:08:47,164+0800 [component-shutdown-thread] INFO
org.apache.pulsar.common.util.GracefulExecutorServicesTerminationHandler -
Starting termination handler for 1 executors.
2023-12-09T18:08:47,165+0800 [component-shutdown-thread] INFO
org.apache.pulsar.common.util.GracefulExecutorServicesTerminationHandler -
Shutdown completed.
2023-12-09T18:08:47,165+0800 [component-shutdown-thread] INFO
org.apache.pulsar.common.util.GracefulExecutorServicesTerminationHandler -
Starting termination handler for 1 executors.
2023-12-09T18:08:47,165+0800 [component-shutdown-thread] INFO
org.apache.pulsar.common.util.GracefulExecutorServicesTerminationHandler -
Shutdown completed.
`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
