tranactions can across two kafka cluster ?

Hi, I want to know if consume from A kafka cluster -> process -> produce to B kafka cluster, is supported by the kafka-2.2.1 Both kafka cluster support transaction. Thanks first .

Re: Kafka upgrade from 0.10 to 2.3.x

I have done this before. What Matthias said below is correct. First you’ve got to stop all apps to prevent data consumption (if that’s what you also mean by having downtime) Then, you can go ahead and replace the bin. Regards, On Tue, 12 May 2020 at 18:33, Matthias J. Sax wrote: > I guess

AzkarraStreams 0.7.0 released

Hi everyone, Yesterday, StreamThoughts.io released Azkarra Streams 0.7.0 ( https://www.azkarrastreams.io/) For those not familiar, Azkarra Streams is an open-source project dedicated to making the development of streaming microservices, based on Kafka Streams, simple and fast. To get a

Re: Kafka ACL Support

KAFKA ACL support there for all version . On 5/13/20, 8:02 AM, "Jadhawar, Ganesh" wrote: [External] Hi Team, Please let us know kafka ACL authorizer is support from which kafka release. Thanks, Ganesh This e-mail and any files transmitted with it are for the sole use

kafka connector distributed mode balance stratety

I want to know how kafka connector under distributed mode balance its task？ For example I have two connector instance： 192.168.10.2:8083, 192.168.10.3:8083 If one killed, the task can be transfered to another automatically without any data loss? When i use restful API curl

Re: Kafka metrics

Hi All, Thanks a lot for the information and suggestion! Eleanore On Tue, May 12, 2020 at 3:24 PM Malcolm McFarland wrote: > These ideas are specific to Samza and ymmv in how they apply to other > processing frameworks, but we use a couple of custom tools to keep tabs on > processing lag: > >

Jdbc Source Connector Config

Hi Guys, i am having a question. "transforms":"createKey,extractInt", "transforms.createKey.type":"org.apache.kafka.connect.transforms.ValueToKey", "transforms.createKey.fields":"id", "transforms.extractInt.type":"org.apache.kafka.connect.transforms.ExtractField$Key",

Re: data structures used by GlobalKTable, KTable

Matthias, For GlobalKTable, I am looking at the APIs provided by StreamsBuilder and I don't see any option to mention in-memory store there: all these API documentation states that The resulting GlobalKTable

hangup of kafka consumer in case of unclean leader election

It seems, that we discovered a bug: In case if unclean leader election happened, KafkaConsumer may hang up indefinitely Full version According to documentation, in case if `auto.offset.reset` is set to none or not set, the exception is thrown to a client code, allowing to handle it in a way that

Re: Jdbc Source Connector Config

You don't have to use Single Message Transform (which is what these are) at all if you don't want to. However, they do serve a useful purpose where you want to modify data as it passes through Kafka Connect. Ref: -

Re: Kafka upgrade from 0.10 to 2.3.x

It would be a good idea to attempt this upgrade in a different environment like QA or STAGING to make sure there are no surprises first before upgrading PRODUCTION Going from 0.10 to 2.3.x is a significant jump with potential for issues Running a trial in a lower environment with exact setup as

Kafka ACL Support

Hi Team, Please let us know kafka ACL authorizer is support from which kafka release. Thanks, Ganesh