BewareMyPower edited a comment on issue #11962: URL: https://github.com/apache/pulsar/issues/11962#issuecomment-915274820
@codelipenghui You can see https://github.com/streamnative/kop/pull/673 for more details about the GC problem. In this PR, I used the direct memory allocator and the GC problem was fixed. The left heap memory usage is a KoP side problem, not related to data format conversion. Before this PR, deserializing Kafka records also doesn't use heap memory. 1. Kafka records to Pulsar message - Read records (no memory allocated) - Create Pulsar message (memory allocated from direct memory) 2. Pulsar message to Kafka records - Read message (no memory allocated) - Create Kafka records (the default `MemoryRecords` allocates memory from heap memory, then GC happens, and this problem was solved by https://github.com/streamnative/kop/pull/673) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
