Re: Facing MESSAGE_TOO_LARGE

2022-07-01 Thread Malcolm McFarland
fka's perspective. Cheers, Malcolm McFarland Cavulus On Fri, Jul 1, 2022 at 1:13 PM Divya Jain wrote: > Hi, > > It's the max that could be defined. It cannot go beyond it. I am not sure > how to solve this. > > Thanks > Divya Jain > > > On Sat, 2 Jul, 2022, 1:

Re: KAFKA- UNDER_REPLICATED_PARTIONS - AUTOMATE

2022-02-25 Thread Malcolm McFarland
Maybe this could help? https://github.com/dimas/kafka-reassign-tool Cheers, Malcolm McFarland Cavulus On Fri, Feb 25, 2022 at 9:00 AM Kafka Life wrote: > Dear Experts > > do you have any solution for this please > > On Tue, Feb 22, 2022 at 8:31 PM Kafka Life wrote: > >

Re: Please Help with Error: org.apache.kafka.common.network.InvalidReceiveException: Invalid receive (size = ...

2021-08-06 Thread Malcolm McFarland
Hi Roger, It looks like you need to update your broker configuration to include a higher value for message.max.bytes. Hth, Malcolm McFarland Cavulus This correspondence is from HealthPlanCRM, LLC, d/b/a Cavulus. Any unauthorized or improper disclosure, copying, distribution, or use of the

Re: Latency requirements for Kafka connect workers

2021-01-15 Thread Malcolm McFarland
-config Adding/removing connectors _is_ done via REST though: https://docs.confluent.io/5.5.0/connect/references/restapi.html#connect-userguide-rest Cheers, Malcolm McFarland Cavulus This correspondence is from HealthPlanCRM, LLC, d/b/a Cavulus. Any unauthorized or improper disclosure, copying

Re: Kafka Streams: Read from one Bootstrap server & write to other

2020-12-01 Thread Malcolm McFarland
How about a lightweight MirrorMaker instance for just this topic? Malcolm McFarland Cavulus This correspondence is from HealthPlanCRM, LLC, d/b/a Cavulus. Any unauthorized or improper disclosure, copying, distribution, or use of the contents of this message is prohibited. The information

Re: EXTERNAL: Re: Backup Apache KAFKA

2020-11-23 Thread Malcolm McFarland
useful if you want a persistent record of activity in your system. Cheers, Malcolm McFarland Cavulus This correspondence is from HealthPlanCRM, LLC, d/b/a Cavulus. Any unauthorized or improper disclosure, copying, distribution, or use of the contents of this message is prohibited. The information containe

Re: Kafka streams - how to handle application level exception in event processing

2020-09-21 Thread Malcolm McFarland
is _will_ pause that entire partition while waiting for the process status to evaluate to true, so bear that in mind. In our case that's exactly what we want, but you may not want to actually halt processing, just postpone processing of this specific message. Cheers, Malcolm McFarland Cavulus

Re: Advice for Kafka project in Africa...

2020-09-08 Thread Malcolm McFarland
Samza) to actually update a database state from this event data. However, the events themselves are not the full database. I haven't explored ksqlDB at all; perhaps somebody familiar with it could weigh in here. Cheers, Malcolm McFarland Cavulus On Thu, Sep 3, 2020 at 12:58 AM Gaurav Ba

Re: Kafka metrics

2020-05-12 Thread Malcolm McFarland
ic if it gets too large) These two tools have been invaluable in helping us monitor our Samza processing clusters. Cheers, Malcolm McFarland Cavulus This correspondence is from HealthPlanCRM, LLC, d/b/a Cavulus. Any unauthorized or improper disclosure, copying, distribution, or use of the conten

Potential message incompatibility between versions 0.11 and 2.2.1 of Kafka?

2020-04-10 Thread Malcolm McFarland
librdkafka 0.8.6 *cannot*. Could there be a version incompatibility with how the data is being stored on the kafka server? Cheers, Malcolm McFarland Cavulus