GitHub user sourabhaggrawal closed a discussion: Bookkeeper Direct Memory 
Consumption is High

We have observed that in bookkeeper Direct Memory which was set to 4GB for a 
long time (2-3 years), is getting consumed fully (may be after upgrading to 
2.10.1) , we noticed this 3 months back thats when we upgraded the cluster to 
2.10.1.

We went ahead and beefed up the server with double capacity and allocated 20GB 
of Direct Memory (because thats where it got stabilised). But now we see that 
even 20GB was also getting fully consumed and bookkeeper kept restarting 


We also have a problem of our ledger disk getting full and not deleting the 
expired ledgers or not reclaiming the free space and I believe Direct Memory 
could be a reason of this problem too. Because GC also make use of Memory to 
delete ledgers. 

I have attached a screenshot of DirectMemory of one node and the pattern is 
same for other nodes too.

Any leads on what could be the reason and how to fix it ?

<img width="1335" alt="Screenshot 2023-02-28 at 6 19 34 PM" 
src="https://user-images.githubusercontent.com/70515711/221858733-016cd226-d73e-4ef6-af69-614c6f6f75b7.png";>


GitHub link: https://github.com/apache/pulsar/discussions/19663

----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]

Reply via email to