rdhabalia commented on PR #23395: URL: https://github.com/apache/pulsar/pull/23395#issuecomment-2401324983
I am also adding email thread reply here >> I want to revert this PR. Background: When the schemas of a topic are lost, all of the messages in the topic can not be consumed successfully, and producers can not publish messages anymore. We must not revert this PR and broker must not allow topic unavailability in any cases and we can't rely on manual operational efforts to fix any topic server side issue There are already many issues created related to the lost schema ledgers so, it is a very well-known issue that the topic becomes unavailable and producers are not able to publish messages anymore just because of server issues which is extremely critical for mission-critical usecases and not acceptable as well. Because of that brokers must be fault tolerant to recover in case of missing ledgers. Broker already handles such issues during manged-ledger or managed-cursor legers but it should also handle in case of schema ledger as well and make sure that broker won't impact topic's unavailability. It is also very important to just not rely on operational effort to fix such unavailability issues manually but broker should have a mechanism to recover by itself, Therefore, this PR is important to make sure tenants don't face topic unavailability due to well known issues of missing schema ledgers. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
