Hi,
Many thanks for your info!
As you said, I think my configuration might be running two separate instances
of zookeeper rather than a cluster, so I modify the configuration file as below
and start up three zookeeper instances in separate machines. While the
zookeeper launched, some error occurred that "/tmp/zookeeper/myid file is
missing ". From zookeeper document, it said " When the server starts up, it
knows which server it is by looking for the file myid in the data directory.
That file has the contains the server number, in ASCII." If the file myid will
be created automatically or manually by myself? What's format for the file
myid? Thanks!
Previous configuration:
dataDir=/tmp/zookeeper
clientPort=2181
maxClientCnxns=0
Current configuration:
dataDir=/tmp/zookeeper
clientPort=2181
maxClientCnxns=0
# For replicated mode
tickTime=2000
initLimit=5
syncLimit=2
server.1=192.168.210.5:2888:3888
server.2=192.168.210.6:2888:3888
server.3=192.168.210.8:2888:3888
# /root/kafka_2.8.0-0.8.0/bin/zookeeper-server-start.sh
config/zookeeper.properties
[2016-11-15 03:11:54,143] INFO Reading configuration from:
config/zookeeper.properties
(org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2016-11-15 03:11:54,145] INFO Defaulting to majority quorums
(org.apache.zookeeper.server.quorum.QuorumPeerConfig)
[2016-11-15 03:11:54,146] FATAL Invalid config, exiting abnormally
(org.apache.zookeeper.server.quorum.QuorumPeerMain)
org.apache.zookeeper.server.quorum.QuorumPeerConfig$ConfigException: Error
processing config/zookeeper.properties
at
org.apache.zookeeper.server.quorum.QuorumPeerConfig.parse(QuorumPeerConfig.java:110)
at
org.apache.zookeeper.server.quorum.QuorumPeerMain.initializeAndRun(QuorumPeerMain.java:99)
at
org.apache.zookeeper.server.quorum.QuorumPeerMain.main(QuorumPeerMain.java:76)
Caused by: java.lang.IllegalArgumentException: /tmp/zookeeper/myid file is
missing
at
org.apache.zookeeper.server.quorum.QuorumPeerConfig.parseProperties(QuorumPeerConfig.java:320)
at
org.apache.zookeeper.server.quorum.QuorumPeerConfig.parse(QuorumPeerConfig.java:106)
... 2 more
Invalid config, exiting abnormally
Best Regards
Johnny
-----Original Message-----
From: Karolis Pocius [mailto:k.poc...@adform.com]
Sent: 2016年11月14日 17:25
To: users@kafka.apache.org
Subject: Re: Create topic with multi-zookeeper URLs
Can you explain how you launched those two zookeeper instances and maybe share
their config? You need to make some edits to config in order to run a zookeeper
cluster - I have a feeling you might be running two separate instances of
zookeeper rather than a cluster. Also, if you want a cluster you should run
zookeeper in odd numbers. From zookeeper documentation
https://zookeeper.apache.org/doc/trunk/zookeeperStarted.html
> For replicated mode, a minimum of three servers are required, and it
> is strongly recommended that you have an odd number of servers. If you
> only have two servers, then you are in a situation where if one of
> them fails, there are not enough machines to form a majority quorum.
> Two servers is inherently *less* stable than a single server, because
> there are two single points of failure.
On 2016.11.14 11:05, ZHU Hua B wrote:
> Hi All,
>
>
> I want to create a topic with command "bin/kafka-topics.sh --create
> --zookeeper HOST:PORT --replication-factor 1 --partitions 1 --topic test", if
> the option "--zookeeper" could point to multi-zookeeper URLs such as
> "HOST1:PORT1,HOST2:PORT2"?
> I tried it as below seems the topic only be listed under the first zookeeper
> URL. But the description of this option said "Multiple URLS can be given to
> allow fail-over." If my usage is wrong? Thanks!
>
>
> # bin/kafka-topics.sh --create --zookeeper HOST1:PORT1,HOST2:PORT2 --
> replication-factor 1 --partitions 1 --topic test creation succeeded!
>
> # bin/kafka-list-topic.sh --zookeeper HOST1:PORT1
> topic: test partition: 0 leader: 0 replicas: 0 isr: 0
>
> # bin/kafka-list-topic.sh --zookeeper HOST2:PORT2 no topics exist!
>
> # bin/kafka-topics.sh
> --zookeeper <urls> REQUIRED: The connection string for
> the zookeeper connection in the
> form
> host:port. Multiple URLS can be
> given to allow fail-over.
>
>
> Best Regards
>
> Johnny
>
>
