[GitHub] [bookkeeper] Nicklee007 opened a new pull request, #3802: Add trigger entry location index rocksDB compact REST API

Thu, 23 Feb 2023 04:08:42 -0800 


Nicklee007 opened a new pull request, #3802:
URL: https://github.com/apache/bookkeeper/pull/3802

   ### Motivation
   After the bookie instance running long time, the bookie entry location index 
rocksDB `.sst` file size maybe expand to 20-30GB as one ledger data dir's 
location index in some case, which will cause the rocksDB scan operator cost 
more time and cause the bookie client request timeout.
   
   Add trigger entry location index rocksDB compact REST API which can trigger  
entry location rocksDB compaction and get the compaction status. 
   
   The full range entry location index rocksDB compact will cause the entry 
location index dir express higher IOUtils. So we'd better trigger the entry 
location rocksDB compact by the api in low data flow period.
   
   **Some case before rocksDB compact:**
   <img width="232" alt="image" 
src="https://user-images.githubusercontent.com/84127069/220893469-e6fbc1a3-c767-4ffe-8ae9-f05ad1833c50.png";>
   
   
   <img width="288" alt="image" 
src="https://user-images.githubusercontent.com/84127069/220891359-dc37e139-37b0-461b-8001-dcc48517366c.png";>
   
   **After rocksDB compact:**
   <img width="255" alt="image" 
src="https://user-images.githubusercontent.com/84127069/220891419-24267fa7-348c-4fbd-8b3e-70a99840bce5.png";>
   
   ### Changes
   1. Add  REST API  to trigger entry location index rocksDB compact.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to