codelipenghui commented on issue #9288: URL: https://github.com/apache/pulsar/issues/9288#issuecomment-767303356
Currently, the `autoSkipNonRecoverableData=true` only skip the cases that the broker can't read data from ledger such LedgerNotFoundException or LedgerMetadataDoesNotExists exception. For the cases that shutdown multiple bookies, the broker will encounter LedgerHandleNotAvaliableException which can't be handled by `autoSkipNonRecoverableData=true`. From the Pulsar perspective, the crashed bookies can not ensure that the data cannot be recovered but the specific LedgerNotFoundException or LedgerMetadataDoesNotExists can. So the `autoSkipNonRecoverableData=true` only skips the cases that the data truly can't be recovered. For support to continue to consume messages that the cluster encounter multiple bookies not available scenario. We should introduce a new config `autoSkipNonAvailableBookies`. What do you think @merlimat @sijie @jiazhai ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
