A search of git history gave me these.
914d2f9 BIGTOP-2754: Revert "BIGTOP-2730: Upgrade Zookeeper to version
3.4.10"
b00ac09 BIGTOP-2730: Upgrade Zookeeper to version 3.4.10

And then in this https://issues.apache.org/jira/browse/BIGTOP-2754, there
is a saying "Since Hadoop enforces zookeeper-3.6 (correction 3.4.6) we will
revert BIGTOP-2730 <https://issues.apache.org/jira/browse/BIGTOP-2730> in
order to wait for upstream to deal with this issue.

Is there any change in Hadoop ever since then?

PS: let me know if anybody have kafka-server launched successfully in
bigtop 1.4 branch.

-Guodong


On Mon, Apr 15, 2019 at 1:37 PM Guodong Xu <[email protected]> wrote:

> Hi,
>
> I am working on branch 'master'. But since Kafka and zookeeper versions in
> 1.4 and in master branch are exactly the same, so I believe the issue
> exists for 1.4 as well. (let me know if anybody has tested and found no).
>
> When I set up a multi-node container based cluster
> (./provisioner/docker/docker-hadoop.sh -c 3), I noticed this error, which
> is fatal to Kafka-server:
> "java.lang.NoClassDefFoundError:org/apache/zookeeper/AsyncCallback$MultiCallback
> "
> Logs are in below.
>
> Root cause of this problem is 'AsyncCallback MultiCallback' is defined in
> Zookeeper only since 3.4.7. However, Bigtop master (and 1.4) included
> Zookeeper 3.4.6.
>
> See here for similar discussion from Spark community:
> https://mail-archives.apache.org/mod_mbox/spark-reviews/201811.mbox/%[email protected]%3E
>
>
> Kafka version is upgraded to 2.1.1 in Bigtop 1.4. That's why I didn't such
> error in previous releases like Bigtop 1.3. In Bigtop 1.3, Kafka version is
> 0.10.2.2, and it runs well with Zookeeper 3.4.6.
>
> -Guodong
>
> ==
> master branch or 1.4.0:
> Error: Could not start Service[kafka-server]: Execution of
> '/usr/bin/systemctl start kafka-server' returned 1: Job for
> kafka-server.service failed because the control process exited with error
> code. See "systemctl status kafka-server.service" and "journalctl -xe" for
> details.
> Wrapped exception:
> Execution of '/usr/bin/systemctl start kafka-server' returned 1: Job for
> kafka-server.service failed because the control process exited with error
> code. See "systemctl status kafka-server.service" and "journalctl -xe" for
> details.
> Error: /Stage[main]/Kafka::Server/Service[kafka-server]/ensure: change
> from stopped to running failed: Could not start Service[kafka-server]:
> Execution of '/usr/bin/systemctl start kafka-server' returned 1: Job for
> kafka-server.service failed because the control process exited with error
> code. See "systemctl status kafka-server.service" and "journalctl -xe" for
> details.
>
> [root@63f5c5a99d8d /]# systemctl status kafka-server.service
> ● kafka-server.service - LSB: Kafka Server
>    Loaded: loaded (/etc/rc.d/init.d/kafka-server; bad; vendor preset:
> disabled)
>    Active: failed (Result: exit-code) since Mon 2019-04-15 03:48:45 UTC;
> 1min 29s ago
>      Docs: man:systemd-sysv-generator(8)
>
> Apr 15 03:48:42 63f5c5a99d8d systemd[1]: Starting LSB: Kafka Server...
> Apr 15 03:48:42 63f5c5a99d8d kafka-server[9344]: Starting Kafka Server
> (kafka-server):[  OK  ]
> Apr 15 03:48:42 63f5c5a99d8d kafka-server[9344]: Starting  (kafka-server):
> Apr 15 03:48:42 63f5c5a99d8d su[9370]: (to kafka) root on none
> Apr 15 03:48:45 63f5c5a99d8d kafka-server[9344]: Failure to start Kafka
> Server (kafka-server). Return value: 1[FAILED]
> Apr 15 03:48:45 63f5c5a99d8d systemd[1]: kafka-server.service: control
> process exited, code=exited status=1
> Apr 15 03:48:45 63f5c5a99d8d systemd[1]: Failed to start LSB: Kafka Server.
> Apr 15 03:48:45 63f5c5a99d8d systemd[1]: Unit kafka-server.service entered
> failed state.
> Apr 15 03:48:45 63f5c5a99d8d systemd[1]: kafka-server.service failed.
>
> = /var/log/kafka/kafka-server.out
> java.lang.NoClassDefFoundError:
> org/apache/zookeeper/AsyncCallback$MultiCallback
>         at kafka.zk.KafkaZkClient$.apply(KafkaZkClient.scala:1693)
>         at
> kafka.server.KafkaServer.kafka$server$KafkaServer$$createZkClient$1(KafkaServer.scala:348)
>         at kafka.server.KafkaServer.initZkClient(KafkaServer.scala:372)
>         at kafka.server.KafkaServer.startup(KafkaServer.scala:202)
>         at
> kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)
>         at kafka.Kafka$.main(Kafka.scala:75)
>         at kafka.Kafka.main(Kafka.scala)
>
> Caused by: java.lang.ClassNotFoundException:
> org.apache.zookeeper.AsyncCallback$MultiCallback
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>         ... 7 more
> [2019-04-15 03:55:24,859] INFO shutting down (kafka.server.KafkaServer)
> [2019-04-15 03:55:24,865] INFO shut down completed
> (kafka.server.KafkaServer)
> [2019-04-15 03:55:24,865] ERROR Exiting Kafka.
> (kafka.server.KafkaServerStartable)
> [2019-04-15 03:55:24,868] INFO shutting down (kafka.server.KafkaServer)
>
>

Reply via email to