Re: major reduction is performance when using schema registry - KafkaIO

2023-04-09 Thread Sigalit Eliazov
hi, KafkaIO.read() .withBootstrapServers(bootstrapServers) .withTopic(topic) .withConsumerConfigUpdates(Map.ofEntries( Map.entry("schema.registry.url", registryURL), Map.entry(ConsumerConfig.GROUP_ID_CONFIG, consumerGroup+

Re: major reduction is performance when using schema registry - KafkaIO

2023-04-09 Thread Reuven Lax via user
How are you using the schema registry? Do you have a code sample? On Sun, Apr 9, 2023 at 3:06 AM Sigalit Eliazov wrote: > Hello, > > I am trying to understand the effect of schema registry on our pipeline's > performance. In order to do sowe created a very simple pipeline that reads > from

major reduction is performance when using schema registry - KafkaIO

2023-04-09 Thread Sigalit Eliazov
Hello, I am trying to understand the effect of schema registry on our pipeline's performance. In order to do sowe created a very simple pipeline that reads from kafka, runs a simple transformation of adding new field and writes of kafka. the messages are in avro format I ran this pipeline with