[ https://issues.apache.org/jira/browse/KAFKA-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16498970#comment-16498970 ]
Remil commented on KAFKA-6984: ------------------------------ Hello ManiKumar, Thanks for the help. I am able to download the binary but unable to connect to zookeeper from Kafka. hadoopuser@sherin-VirtualBox:/usr/local/kafka/kafka_2.11-1.1.0/bin$ sudo su -p - zookeeper -c "/usr/local/zookeeper/zookeeper-3.4.12/bin/zkServer.sh start" ZooKeeper JMX enabled by default ZooKeeper JMX enabled by default Using config: /usr/local/zookeeper/zookeeper-3.4.12/bin/../conf/zoo.cfg Starting zookeeper ... STARTED hadoopuser@sherin-VirtualBox:/usr/local/kafka/kafka_2.11-1.1.0/bin$ sudo /usr/local/kafka/kafka_2.11-1.1.0/bin/kafka-server-start.sh /usr/local/kafka/kafka_2.11-1.1.0/config/server.properties [2018-06-02 15:20:00,835] INFO Registered kafka:type=kafka.Log4jController MBean (kafka.utils.Log4jControllerRegistration$) [2018-06-02 15:20:01,659] INFO starting (kafka.server.KafkaServer) [2018-06-02 15:20:01,662] INFO Connecting to zookeeper on localhost:2181 (kafka.server.KafkaServer) [2018-06-02 15:20:01,733] INFO [ZooKeeperClient] Initializing a new session to localhost:2181. (kafka.zookeeper.ZooKeeperClient) [2018-06-02 15:20:01,758] INFO Client environment:zookeeper.version=3.4.10-39d3a4f269333c922ed3db283be479f9deacaa0f, built on 03/23/2017 10:13 GMT (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,779] INFO Client environment:host.name=sherin-VirtualBox (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,779] INFO Client environment:java.version=1.8.0_171 (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,779] INFO Client environment:java.vendor=Oracle Corporation (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,780] INFO Client environment:java.home=/usr/lib/jvm/java-8-oracle/jre (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,780] INFO Client environment:java.class.path=/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/aopalliance-repackaged-2.5.0-b32.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/argparse4j-0.7.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/commons-lang3-3.5.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/connect-api-1.1.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/connect-file-1.1.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/connect-json-1.1.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/connect-runtime-1.1.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/connect-transforms-1.1.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/guava-20.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/hk2-api-2.5.0-b32.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/hk2-locator-2.5.0-b32.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/hk2-utils-2.5.0-b32.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jackson-annotations-2.9.4.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jackson-core-2.9.4.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jackson-databind-2.9.4.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jackson-jaxrs-base-2.9.4.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jackson-jaxrs-json-provider-2.9.4.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jackson-module-jaxb-annotations-2.9.4.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/javassist-3.20.0-GA.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/javassist-3.21.0-GA.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/javax.annotation-api-1.2.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/javax.inject-1.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/javax.inject-2.5.0-b32.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/javax.servlet-api-3.1.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/javax.ws.rs-api-2.0.1.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jersey-client-2.25.1.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jersey-common-2.25.1.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jersey-container-servlet-2.25.1.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jersey-container-servlet-core-2.25.1.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jersey-guava-2.25.1.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jersey-media-jaxb-2.25.1.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jersey-server-2.25.1.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jetty-client-9.2.24.v20180105.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jetty-continuation-9.2.24.v20180105.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jetty-http-9.2.24.v20180105.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jetty-io-9.2.24.v20180105.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jetty-security-9.2.24.v20180105.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jetty-server-9.2.24.v20180105.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jetty-servlet-9.2.24.v20180105.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jetty-servlets-9.2.24.v20180105.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jetty-util-9.2.24.v20180105.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/jopt-simple-5.0.4.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/kafka_2.11-1.1.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/kafka_2.11-1.1.0-sources.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/kafka_2.11-1.1.0-test-sources.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/kafka-clients-1.1.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/kafka-log4j-appender-1.1.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/kafka-streams-1.1.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/kafka-streams-examples-1.1.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/kafka-streams-test-utils-1.1.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/kafka-tools-1.1.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/log4j-1.2.17.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/lz4-java-1.4.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/maven-artifact-3.5.2.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/metrics-core-2.2.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/osgi-resource-locator-1.0.1.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/plexus-utils-3.1.0.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/reflections-0.9.11.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/rocksdbjni-5.7.3.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/scala-library-2.11.12.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/scala-logging_2.11-3.7.2.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/scala-reflect-2.11.12.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/slf4j-api-1.7.25.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/slf4j-log4j12-1.7.25.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/snappy-java-1.1.7.1.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/validation-api-1.1.0.Final.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/zkclient-0.10.jar:/usr/local/kafka/kafka_2.11-1.1.0/bin/../libs/zookeeper-3.4.10.jar (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,781] INFO Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,782] INFO Client environment:java.io.tmpdir=/tmp (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,783] INFO Client environment:java.compiler=<NA> (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,784] INFO Client environment:os.name=Linux (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,784] INFO Client environment:os.arch=amd64 (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,785] INFO Client environment:os.version=4.4.0-124-generic (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,785] INFO Client environment:user.name=root (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,790] INFO Client environment:user.home=/root (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,790] INFO Client environment:user.dir=/usr/local/kafka/kafka_2.11-1.1.0/bin (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,792] INFO Initiating client connection, connectString=localhost:2181 sessionTimeout=6000 watcher=kafka.zookeeper.ZooKeeperClient$ZooKeeperClientWatcher$@49ec71f8 (org.apache.zookeeper.ZooKeeper) [2018-06-02 15:20:01,874] INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2018-06-02 15:20:01,875] INFO [ZooKeeperClient] Waiting until connected. (kafka.zookeeper.ZooKeeperClient) [2018-06-02 15:20:01,903] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141) [2018-06-02 15:20:03,012] INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2018-06-02 15:20:03,014] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141) [2018-06-02 15:20:04,140] INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2018-06-02 15:20:04,144] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141) [2018-06-02 15:20:05,251] INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2018-06-02 15:20:05,252] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141) [2018-06-02 15:20:06,355] INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2018-06-02 15:20:06,363] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141) [2018-06-02 15:20:07,470] INFO Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) (org.apache.zookeeper.ClientCnxn) [2018-06-02 15:20:07,471] WARN Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn) java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141) [2018-06-02 15:20:07,884] ERROR Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer) kafka.zookeeper.ZooKeeperClientTimeoutException: Timed out waiting for connection while in state: CONNECTING at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply$mcV$sp(ZooKeeperClient.scala:225) at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply(ZooKeeperClient.scala:221) at kafka.zookeeper.ZooKeeperClient$$anonfun$kafka$zookeeper$ZooKeeperClient$$waitUntilConnected$1.apply(ZooKeeperClient.scala:221) at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:250) at kafka.zookeeper.ZooKeeperClient.kafka$zookeeper$ZooKeeperClient$$waitUntilConnected(ZooKeeperClient.scala:221) at kafka.zookeeper.ZooKeeperClient.<init>(ZooKeeperClient.scala:95) at kafka.zk.KafkaZkClient$.apply(KafkaZkClient.scala:1538) at kafka.server.KafkaServer.kafka$server$KafkaServer$$createZkClient$1(KafkaServer.scala:345) at kafka.server.KafkaServer.initZkClient(KafkaServer.scala:369) at kafka.server.KafkaServer.startup(KafkaServer.scala:202) at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38) at kafka.Kafka$.main(Kafka.scala:92) at kafka.Kafka.main(Kafka.scala) [2018-06-02 15:20:07,896] INFO shutting down (kafka.server.KafkaServer) [2018-06-02 15:20:07,906] WARN (kafka.utils.CoreUtils$) java.lang.NullPointerException at kafka.server.KafkaServer$$anonfun$shutdown$5.apply$mcV$sp(KafkaServer.scala:569) at kafka.utils.CoreUtils$.swallow(CoreUtils.scala:85) at kafka.server.KafkaServer.shutdown(KafkaServer.scala:569) at kafka.server.KafkaServer.startup(KafkaServer.scala:326) at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38) at kafka.Kafka$.main(Kafka.scala:92) at kafka.Kafka.main(Kafka.scala) [2018-06-02 15:20:07,940] INFO shut down completed (kafka.server.KafkaServer) [2018-06-02 15:20:07,941] ERROR Exiting Kafka. (kafka.server.KafkaServerStartable) [2018-06-02 15:20:07,945] INFO shutting down (kafka.server.KafkaServer) hadoopuser@sherin-VirtualBox:/usr/local/kafka/kafka_2.11-1.1.0/bin$ > Question > -------- > > Key: KAFKA-6984 > URL: https://issues.apache.org/jira/browse/KAFKA-6984 > Project: Kafka > Issue Type: Bug > Reporter: Remil > Priority: Major > > hadoopuser@sherin-VirtualBox:~$ sudo su -p - zookeeper -c > "/usr/local/zookeeper/zookeeper-3.4.12/bin/zkServer.sh start" ZooKeeper JMX > enabled by default > ZooKeeper JMX enabled by default > Using config: /usr/local/zookeeper/zookeeper-3.4.12/bin/../conf/zoo.cfg > Starting zookeeper ... STARTED > hadoopuser@sherin-VirtualBox:~$ sudo > /opt/kafka/kafka-1.1.0-src/bin/kafka-server-start.sh > /opt/kafka/kafka-1.1.0-src/config/server.properties > Classpath is empty. Please build the project first e.g. by running './gradlew > jar -PscalaVersion=2.11.12' > hadoopuser@sherin-VirtualBox:~$ ./gradlew jar -PscalaVersion=2.11.12 > bash: ./gradlew: No such file or directory > hadoopuser@sherin-VirtualBox:~$ sudo updatedb > hadoopuser@sherin-VirtualBox:~$ locate gradlew > hadoopuser@sherin-VirtualBox:~$ ./gradlew jar -PscalaVersion=2.11.12 > bash: ./gradlew: No such file or directory > hadoopuser@sherin-VirtualBox:~$ -- This message was sent by Atlassian JIRA (v7.6.3#76005)