vraulji567 opened a new pull request, #4678:
URL: https://github.com/apache/bookkeeper/pull/4678

   ### Motivation
   
   Replication worker fails to replicate ledgers with thousands of entries when 
`auditorLedgerVerificationPercentage` is set to 100. The verification process 
makes too many read requests at once exceeding 
`maxPendingReadRequestsPerThread` and fails with `Too many requests to the same 
Bookie while reading`. The verification process should not make too many 
simultaneous reads and throttle the reads based on 
`inFlightReadEntryNumInLedgerChecker`. 
   
   
   ### Changes
   
   Pass the config to the verification process(LedgerChecker) while 
initializing it as part of the Replication worker to throttle the number of 
simultaneous reads to the bookie preventing  `Too many requests to the same 
Bookie while reading` error and replication of large ledgers with 100% 
verification possible.
   
   Added a test to verify the throttling logic.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to