I'm still not getting the necessary behavior. If I run on the command line, I
get a series of messages:
$ ./kafka-console-consumer.sh --zookeeper w.x.y.z:p --topic test
--from-beginning
Test
test
tests
asdf
If I exclude the --from-beginning argument then it hangs, which
Are you using mumrah/kafka-python? I think so from context but I know
there's at least one other implementation rattling around these days. (-:
If that's what you're using, I can see two potential problems you might be
having. You can set the offset to some approximation of wherever you
Sure. It would be great if you could as well explain the reason why the
absence of the jar creates this problem
Also, I'm surprised that zookeeper that comes bundled with kafka 0.8.2 does
not have the jline jar
Regards,
prabcs
On Wed, Jul 29, 2015 at 10:45 PM, Chris Barlock barl...@us.ibm.com
Oh, I'm sorry. If I use the KafkaConsumer class instead of the SimpleConsumer
class (as you suggested) it works. Frustratingly, SimpleConsumer will take the
auto_offset_reset parameter without complaining that no such parameter exists,
yet it doesn't work properly! But KafkaConsumer works,
Have you tried not setting a group_id in SimpleConsumer? If you have stored
offsets in ZK for that group, and those offsets still exist on the server,
the consumer will use them and not 'reset'. My hunch is that is your
problem. You might also consider enabling kafka debug logs (though not for
the
Thanks. I got it to work if I use KafkaConsumer. I doesn't yet work with
SimpleConsumer, and that includes seeking to 0,0. I'm curious what that isn't
getting it going. It's frustrating because SimpleConsumer supports seek while
KafkaConsumer doesn't offer a seek function, but at the same
Hi folks,
*/kafka/bin# ./zookeeper-shell.sh localhost:2182/*
*Connecting to localhost:2182/*
*Welcome to ZooKeeper!*
*JLine support is disabled*
*WATCHER::*
*WatchedEvent state:SyncConnected type:None path:null*
*The shell never says connected*
I'm running 5 node zookeeper cluster on
Mirror Maker does not have specific restrictions on cluster size.
The error you saw was because consumer was not able to talk to the broker.
Can you try to use kafka-console-consumer to consume some data from your
source cluster and see if it works? It should be under KAFKA_HOME/bin/
Jiangjie
I got it. It has been tricky getting both consumer classes to work since they
are not very similar. I configured one incorrectly because they take the
arguments in different orders (in one topic comes before group and in the other
that order is reversed). Now that it works, I can also see
You need the jline JAR file that ships with ZooKeeper.
Chris
IBM Tivoli Systems
Research Triangle Park, NC
(919) 224-2240
Internet: barl...@us.ibm.com
From: Prabhjot Bharaj prabhbha...@gmail.com
To: users@kafka.apache.org, u...@zookeeper.apache.org
Date: 07/29/2015 01:13 PM
Subject:
I'm a user of Kafka/ZooKeeper not one of its developers, so I can't give
you a technical explanation. I do agree that Kafka should ship the jline
JAR if its zookeeper-shell depends on it.
Chris
From: Prabhjot Bharaj prabhbha...@gmail.com
To: u...@zookeeper.apache.org,
Hi Ewen,
Thanks for reply.
The assumptions that you made for replication and partitions are
correct, 120 is total number of partitions and replication factor is 1
for all the topics.
Does that mean that a broker will keep all the messages that are
produced in memory, or will only the unconsumed
On Tue, Jul 28, 2015 at 11:29 PM, Nilesh Chhapru
nilesh.chha...@ugamsolutions.com wrote:
Hi Ewen,
Thanks for reply.
The assumptions that you made for replication and partitions are
correct, 120 is total number of partitions and replication factor is 1
for all the topics.
Does that mean
13 matches
Mail list logo
