hangc0276 commented on issue #2729: URL: https://github.com/apache/bookkeeper/issues/2729#issuecomment-856717441
> @hangc0276 Do you have a chance to run with `-Dio.netty.leakDetectionLevel=advanced -Dio.netty.leakDetection.targetRecords=30` in the JVM options for the BookKeeper server? That would enable the Netty leak detector and print out log entries that would help locate the possible leak. > > It's also possible that there isn't a memory leak and it's simply caused by high memory requirements when there's high load. When using Pulsar, the default configuration for BookKeeper doesn't enable the specific backpressure features that are available in Bookkeeper server (#1409) and client (#1086). There's a separate enhancement request in Pulsar to make use of these features. It is filed as [apache/pulsar#10439](https://github.com/apache/pulsar/issues/10439) . @lhotari Thanks for your feedback. Our production bookkeeper cluster has hundreds of bookie instances, and i should roll restart all bookie instances to add those JVM options. The OOM only occurs when auditor starts to scan all ledgers, and the JVM direct memory monitor shows no direct memory used and the bookie instance with low load. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
