Hi Guys,
I have some doubts about the Kafka, the first is Why sometimes the applications
prefer to connect to zookeeper instead brokers? Connecting to zookeeper could
create an overhead, because we are inserting other element between producer and
consumer. Another question is about the
Have there been any changes with 0.8.2 in how the marker gets moved when
you use the high-level consumer?
One problem I have always had was: what if I pull something from the
stream, but then I have an error in processing it? I don't really want to
move the marker.
I would almost like the
Sorry, I should have read the release notes before I asked this question.
The answer was in there.
Internally the implementation of the offset storage is just a compacted
http://kafka.apache.org/documentation.html#compaction Kafka topic (
__consumer_offsets) keyed on the consumer’s group,
The consumer used Zookeeper to store offsets, in 0.8.2 there's an option
to use Kafka itself for that (by setting *offsets.storage = kafka
Does it still really live in zookeeper, and kafka is proxying the requests
through?
On Sun, Feb 8, 2015 at 9:25 AM, Gwen Shapira gshap...@cloudera.com
On Sun, Feb 8, 2015 at 6:39 AM, Christopher Piggott cpigg...@gmail.com
wrote:
The consumer used Zookeeper to store offsets, in 0.8.2 there's an option
to use Kafka itself for that (by setting *offsets.storage = kafka
Does it still really live in zookeeper, and kafka is proxying the requests
Hi Eduardo,
1. Why sometimes the applications prefer to connect to zookeeper instead
brokers?
I assume you are talking about the clients and some of our tools?
These are parts of an older design and we are actively working on fixing
this. The consumer used Zookeeper to store offsets, in 0.8.2
