[GitHub] [bookkeeper] ramsey8 opened a new issue, #3743: SortedLedgerStorage creates too many entrylog files

[GitBox]

ramsey8 opened a new issue, #3743:
URL: https://github.com/apache/bookkeeper/issues/3743

   *BUG REPORT*
   
   ***Describe the bug***
   
   Recently our production bookie encounters 'too many open files' error, we 
found bookie create much more entrylog file files than we expected,  and the 
metric bookie.bookie_gc_ACTIVE_ENTRY_LOG_COUNT_gauge like this,
   
   <img width="1903" alt="image" 
src="https://user-images.githubusercontent.com/32755366/212839438-d4c8ea2d-23fc-4f11-8d5a-4f6cbea7333b.png";>
   
   There are  many files which  is very small and not satisfy 1GB size.
   
   <img width="724" alt="image" 
src="https://user-images.githubusercontent.com/32755366/212854370-11a0d4f3-120b-413f-896e-07c565191ae5.png";>
   
   we use the **SortedLedgerStorage** and entryLogPerLedgerEnabled is **false**.
   we use arthas to track the create entrylog logic and found this:
   
   
![image](https://user-images.githubusercontent.com/32755366/212841068-58b9540b-08a3-44ad-8f81-e8a2b11c1449.png)
   
   It seems InterleavedLedgerStorage will re-startcheckpoint during rotate 
entrylog, this may cause memtable flush some bytes during perivous and this 
checkpoin,  and createNewlog is invoked again,  this situation will keep loop 
and cannot be broken.
   
   <img width="818" alt="image" 
src="https://user-images.githubusercontent.com/32755366/212856037-4697c1ec-67e2-4e71-bd67-492df7dfc209.png";>
   <img width="748" alt="image" 
src="https://user-images.githubusercontent.com/32755366/212856359-820172d4-0a3d-4541-bf8d-a2f0d7366116.png";>
   
   Please confirm is it a bug or not, if you need more information, please tell 
me.
   Thanks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@bookkeeper.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org