@zookeeper.apache.org
To: dev@zookeeper.apache.org
Subject: Re: KIP-500: Replace ZooKeeper with a Self-Managed Metadata
Quorum
Date: Tue, 13 Aug 2019 12:00:36 -0700
On Tue, Aug 13, 2019 at 10:41 AM Andor Molnar wrote:
> Hmmm... and what should Kafka do if it wants to see all events?
> UseRabbitMQ? :)
On Tue, Aug 13, 2019 at 10:41 AM Andor Molnar wrote:
> Hmmm... and what should Kafka do if it wants to see all events? Use
> RabbitMQ? :)
Kafka should not be using ZK to store messages. And synchronization of
configuration doesn't require message passing.
Read the original ZK paper [1] to
a few of these use cases from the
>>> community, esp downstreams, and evaluate performance, see if we can address.
>>>
>>> Patrick
>>>
>>> On Fri, Aug 2, 2019 at 11:03 AM Michael Han wrote:
>>>
>>>> Folks,
>>>>
>
ne any benchmarking in quite some
> > > time.
> It
> > > would be interesting to collect a few of these use cases from
> > > thecommunity, esp downstreams, and evaluate performance, see if
> > > we can
> address.
> > > Patrick
> > > On Fri, Aug 2, 20
; >>
> > >> I'll also add that we haven't done any benchmarking in quite some
> time.
> > It
> > >> would be interesting to collect a few of these use cases from the
> > >> community, esp downstreams, and evaluate performance, see if we
benchmarking in quite some time.
> It
> >> would be interesting to collect a few of these use cases from the
> >> community, esp downstreams, and evaluate performance, see if we can
> address.
> >>
> >> Patrick
> >>
> >> On F
;
>> On Fri, Aug 2, 2019 at 11:03 AM Michael Han wrote:
>>
>>> Folks,
>>>
>>> Some of you might already see this. Comments?
>>>
>>> https://cwiki.apache.org/confluence/display/KAFKA/KIP-500%3A+Replace+ZooKeeper+with+a+Self-Managed+Metadata+Quorum
&
>
> On Fri, Aug 2, 2019 at 11:03 AM Michael Han wrote:
>
>> Folks,
>>
>> Some of you might already see this. Comments?
>>
>> https://cwiki.apache.org/confluence/display/KAFKA/KIP-500%3A+Replace+ZooKeeper+with+a+Self-Managed+Metadata+Quorum
>>
>
Very useful thread on how watchers work in ZooKeeper and why they work that
way!
I talked with a Kafka dev about this. He said there are only talks for now
about removing ZooKeeper, not going to happen soon, but some people
definitely want it done. They even want their own Leader election, so not
On Wed, Aug 7, 2019 at 5:55 PM Michael Han wrote:
> Related discussions:
> https://lists.apache.org/list.html?d...@kafka.apache.org:lte=1M:KIP-500
>
> >> Why would this lead to any discrepancy? It seems to me that the
> controller, will read an even newer state in such a scenario.
>
> I think in
Related discussions:
https://lists.apache.org/list.html?d...@kafka.apache.org:lte=1M:KIP-500
>> Why would this lead to any discrepancy? It seems to me that the
controller, will read an even newer state in such a scenario.
I think in this case the Kafka side of expectation is not just be able to
On Wed, Aug 7, 2019 at 11:31 AM Karolos Antoniadis
wrote:
> In the paragraph that Michael mentioned, among others it is written: "For
> example, when a partition leader changes its ISR in ZK, the controller will
> typically not learn about these changes for many seconds." Why would it
> take
; > > would be interesting to collect a few of these use cases from the
> > > community, esp downstreams, and evaluate performance, see if we can
> > > address.
> > >
> > > Patrick
> > >
> > > On Fri, Aug 2, 2019 at 11:03 AM Michae
some time.
> It
> > would be interesting to collect a few of these use cases from the
> > community, esp downstreams, and evaluate performance, see if we can
> > address.
> >
> > Patrick
> >
> > On Fri, Aug 2, 2019 at 11:03 AM Michael Han wrote:
> >
; Patrick
>
> On Fri, Aug 2, 2019 at 11:03 AM Michael Han wrote:
>
> > Folks,
> >
> > Some of you might already see this. Comments?
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-500%3A+Replace+ZooKeeper+with+a+Self-Managed+Metadata+Quo
ments?
> >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-500%3A+Replace+ZooKeeper+with+a+Self-Managed+Metadata+Quorum
> >
> >
> > What caught my eyes are:
> >
> > *Worse still, although ZooKeeper is the store of record, the state in
>
fluence/display/KAFKA/KIP-500%3A+Replace+ZooKeeper+with+a+Self-Managed+Metadata+Quorum
>
>
> What caught my eyes are:
>
> *Worse still, although ZooKeeper is the store of record, the state in
> ZooKeeper often doesn't match the state that is held in memory in the
> controller.
Folks,
Some of you might already see this. Comments?
https://cwiki.apache.org/confluence/display/KAFKA/KIP-500%3A+Replace+ZooKeeper+with+a+Self-Managed+Metadata+Quorum
What caught my eyes are:
*Worse still, although ZooKeeper is the store of record, the state in
ZooKeeper often doesn't match
18 matches
Mail list logo
