Re: MM2 for DR

2020-02-12 Thread benitocm
Thanks Ryanne. However what I dont understand clearly if the case of primary crashes, what do I need to do in the secondary? For example, LB at the entrance will just point to the primary front-end so all the data will be injected in the local topic "topic1" in secondary that will be consumed for

Re: [External] Re: MM2 for DR

2020-02-12 Thread benitocm
Hi, I knew about uReplicator but I discarded because it uses Helix. Anyway, I will have a look to the talk Thanks very much On Wed, Feb 12, 2020 at 9:59 PM Brian Sang wrote: > Not sure if you saw this before, but you might be interested in some of the > work Uber has done for inter-cluster rep

RE: Replicas more than replication-factor

2020-02-12 Thread Madhuri Khattar (mkhattar)
Yes filesystem is local. However when I added new broker, it was full clean disk. Madhuri Khattar SR ENGINEER.IT ENGINEERING mkhat...@cisco.com Tel: +1 408 525 5989 Cisco Systems, Inc. 400 East Tasman Drive SAN JOSE 95134 United States cisco.com Think before you print. This email may contain c

Re: Replicas more than replication-factor

2020-02-12 Thread Peter Bukowinski
In cases like this where situation isn’t self-repairing, I stop the at-fault broker and delete the topic-partition directory/directories from the filesystem before starting the broker again. Are you using local storage on your brokers? -- Peter > On Feb 12, 2020, at 8:33 PM, Madhuri Khattar (mk

RE: Replicas more than replication-factor

2020-02-12 Thread Madhuri Khattar (mkhattar)
In my case I figured it was broker 3 and rebooted it after deleting /admin/reassign-partitions since it was stuck there. However I am not having any luck. I still see 400+ underreplicated partitions. I replaced broker 3 as well but still there is no change after almost 7-8 hours now. Madhuri

Re: Replicas more than replication-factor

2020-02-12 Thread Peter Bukowinski
I’ve had this happen a few times when a partition reassignment was underway and one of the brokers that is a destination for the reassignment became unhealthy. This essentially stalls the reassignment indefinitely. The partition with 10 instead of 5 replicas was undergoing a reassignment where a

Re: Replicas more than replication-factor

2020-02-12 Thread SenthilKumar K
We are also facing the similar issue in our kafka cluster. Kafka Version: 2.2.0 RF: 5 PartitionLatest OffsetLeaderReplicasIn Sync ReplicasPreferred Leader?Under Replicated? 0 121 (121,50,51,52,53) (52,121,53,50,51) true false 1 122

?????? [HELP]

2020-02-12 Thread ??????
tks Have a nice dayFrancis Lee QQ : 1026203200  

Replicas more than replication-factor

2020-02-12 Thread Madhuri Khattar (mkhattar)
Hi Today there was some network glich which caused some of my topics to have replicas more than the replication-factor: $ ./kafka-topics --zookeeper sjc-ddzk-01 --topic foodee --describe Topic:foodee PartitionCount:6 ReplicationFactor:2 Configs:retention.ms=34560,segment.ms

Re: MM2 for DR

2020-02-12 Thread Ryanne Dolan
> elaborate a bit more about the active-active Active/active in this context just means that both (or multiple) clusters are used under normal operation, not just during an outage. For this to work, you basically have isolated instances of your application stack running in each DC, with MM2 keepin

Re: [External] Re: MM2 for DR

2020-02-12 Thread Brian Sang
Not sure if you saw this before, but you might be interested in some of the work Uber has done for inter-cluster replication and federation. They of course use their own tool, uReplicator (https://github.com/uber/uReplicator), instead of mirror maker, but you should be able to draw the same insight

Deleting single record from kafka topic

2020-02-12 Thread khoi dinh
Is there a way to delete a single record from kafka. Not through compaction but through an actual command. I know there is the script kafka-delete-records.sh that could delete everything before the specified offset, but I want to delete a single message on the offset I specified. Is there a way

Re: [HELP]

2020-02-12 Thread Guozhang Wang
I've added francis lee (francislee) to the contribution list. On Wed, Feb 12, 2020 at 1:41 AM 萨尔卡 <1026203...@qq.com> wrote: > hi Guozhang Wang, > info in cwiki:  > > > full name: francis lee > mail: francislee...@outlook.com > > > Have a nice dayFrancis Lee > > > QQ : 1026203200 > > >   -- -

Question about KIP-302 & KAFKA-6863 (Load Balancer)

2020-02-12 Thread Lars Francke
Hi, I have a question about KIP-302 and its PR & Jira ticket. I believe I understand the whole thing apart from one bit. In the Jira and the PR it says: "our use case is for multiple load balancers fronting the Kafka cluster. The Kafka advertised listeners advertise hostnames that the DNS server

?????? [HELP]

2020-02-12 Thread ??????
hi Guozhang Wang, info in cwiki:  full name: francis lee mail: francislee...@outlook.com Have a nice dayFrancis Lee QQ : 1026203200