kennknowles commented on issue #20689:
URL: https://github.com/apache/beam/issues/20689#issuecomment-1246005503
Bringing over a significant comment:
> After a lot of attempts, when I deleted this line of code, it worked fine.
>```
> PCollection<KV<String, byte[]>> messages =
> pipeline
> .apply("Read Kafka", KafkaIO.<String, byte[]>read()
> .withBootstrapServers(options.getSourceKafkaUrl())
> .withTopic(options.getSourceTopic())
> .withKeyDeserializer(StringDeserializer.class)
> .withValueDeserializer(ByteArrayDeserializer.class)
> .withConsumerConfigUpdates(ImmutableMap.of(
> "enable.auto.commit", true,
> "group.id", options.getSourceGroupId()))
> //.commitOffsetsInFinalize() // This is the code that
caused the memory leak. I think this is a serious BUG.
> .withoutMetadata()
> );
>
>```
> Looking at THE JVM GC, the old age space is not rising as much as before
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
