Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2019-02-04 Thread Edoardo Comar
Edoardo Comar > > > > IBM Event Streams > > > > > > Edoardo Comar wrote on 13/12/2018 17:50:30: > > > > > From: Edoardo Comar > > > To: dev@kafka.apache.org > > > Date: 13/12/2018 17:50 > > > Subject: Re: [DISCUSS] KIP-39

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2019-01-22 Thread radai
on 13/12/2018 17:50:30: > > > From: Edoardo Comar > > To: dev@kafka.apache.org > > Date: 13/12/2018 17:50 > > Subject: Re: [DISCUSS] KIP-391: Allow Producing with Offsets for > > Cluster Replication > > > > Hi, > > as we haven't got

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2019-01-07 Thread Edoardo Comar
mar > To: dev@kafka.apache.org > Date: 13/12/2018 17:50 > Subject: Re: [DISCUSS] KIP-391: Allow Producing with Offsets for > Cluster Replication > > Hi, > as we haven't got any more feedback, we'd like to start a vote on KIP-391 > on Monday > &g

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-12-13 Thread Edoardo Comar
Ltd, Hursley Park, SO21 2JN Edoardo Comar/UK/IBM wrote on 10/12/2018 10:20:06: > From: Edoardo Comar/UK/IBM > To: dev@kafka.apache.org > Date: 10/12/2018 10:20 > Subject: Re: [DISCUSS] KIP-391: Allow Producing with Offsets for > Cluster Replication > > (shameless bump) an

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-12-10 Thread Edoardo Comar
(shameless bump) any additional feedback is welcome ... thanks! Edoardo Comar wrote on 27/11/2018 15:35:09: > From: Edoardo Comar > To: dev@kafka.apache.org > Date: 27/11/2018 15:35 > Subject: Re: [DISCUSS] KIP-391: Allow Producing with Offsets for > Cluster Replication >

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-27 Thread Edoardo Comar
ll the data > > > is to be assumed with offset, > > > or all without offsets, seems to suffice, > > > So we added only a toplevel flag, not a per-topic-partition one. > > > > > > Thanks for your interest ! > > > cheers > > > Edo > > > -

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-27 Thread Edoardo Comar
f > > > > > > invalid offsets. > > > > > > Same if two producers were sending with offsets, likely both would > > > > then > > > > > > fail. > > > > > > > > > > > > > Does it make sens

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-27 Thread Edoardo Comar
t; > ------ > > > > Edoardo Comar > > > > IBM Event Streams > > IBM UK Ltd, Hursley Park, SO21 2JN > > > > > > Stanislav Kozlovski wrote on 22/11/2018 22:32:42: > > > > > From: Stanislav Koz

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-26 Thread Jason Gustafson
gt; > > Does it make sense to *lock* the topic from other producers while > > > there > > > > > is > > > > > > one that uses offsets? > > > > > > > > > > You could do that with ACL permissions if you wanted, I don't

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-26 Thread Mayuresh Gharat
; > > > need > > > > > the `use_offset` field in the produce request? Maybe we make it > > > > mandatory > > > > > for produce requests with that ACL to have offsets. > > > > > > > > The flag is needed to distinguish a bat

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-26 Thread radai
Hursley Park, SO21 2JN > > > Stanislav Kozlovski wrote on 22/11/2018 22:32:42: > > > From: Stanislav Kozlovski > > To: dev@kafka.apache.org > > Date: 22/11/2018 22:33 > > Subject: Re: [DISCUSS] KIP-391: Allow Producing with Offsets for > > Clust

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-23 Thread Edoardo Comar
> > > > ------------------ > > > > Edoardo Comar > > > > IBM Event Streams > > IBM UK Ltd, Hursley Park, SO21 2JN > > > > > > Stanislav Kozlovski wrote on 22/11/2018 16:17:11: > > > > > F

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-22 Thread Stanislav Kozlovski
--- > > Edoardo Comar > > IBM Event Streams > IBM UK Ltd, Hursley Park, SO21 2JN > > > Stanislav Kozlovski wrote on 22/11/2018 16:17:11: > > > From: Stanislav Kozlovski > > To: dev@kafka.apache.org > > Date: 22/11/2018

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-22 Thread Edoardo Comar
Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN Stanislav Kozlovski wrote on 22/11/2018 16:17:11: > From: Stanislav Kozlovski > To: dev@kafka.apache.org > Date: 22/11/2018 16:17 > Subject: Re: [DISCUSS] KIP-391: Allow Producing with Offsets for > Cluster R

Re: [DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-22 Thread Stanislav Kozlovski
Hey Edurdo, thanks for the KIP! I have some questions, apologies if they are naive: Is this intended to work for a single producer use case only? How would it work if two producers were producing to the same topic with offsets? How would it work if two producers, one with offsets and one without

[DISCUSS] KIP-391: Allow Producing with Offsets for Cluster Replication

2018-11-21 Thread Edoardo Comar
Hi, we've opened a KIP to improve data replication between Kafka clusters : https://cwiki.apache.org/confluence/display/KAFKA/KIP-391%3A+Allow+Producing+with+Offsets+for+Cluster+Replication We'd like to start a discussion, please post your feedback in this thread. Thank you Edo and Mickael