jojochuang opened a new pull request, #7473:
URL: https://github.com/apache/ozone/pull/7473

   ## What changes were proposed in this pull request?
   HDDS-11773. Bump hdds.ratis.snapshot.threshold and 
hdds.container.ratis.statemachine.max.pending.apply-transactions to 100k
   
   Please describe your PR in detail:
   * DataNode is configured to snapshot every 10k transactions, which is too 
frequent for HBase workloads where DataNode can do thousands and eventually 10s 
of thousands of transactions per second. 
   * Bump hdds.ratis.snapshot.threshold to 100k for now. Update 
hdds.container.ratis.statemachine.max.pending.apply-transactions to make it 
consistent.
   * We have to revisit and make it 1M eventually.
   
   ## What is the link to the Apache JIRA
   
   https://issues.apache.org/jira/browse/HDDS-11773
   
   ## How was this patch tested?
   
   Applied the change to a HBase cluster. Previously it was snapshotting every 
4-5 seconds, and now it is doing it about every minute.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to