swaminathanmanish opened a new pull request, #10451: URL: https://github.com/apache/pinot/pull/10451
**Problem**: Currently Zk updates for jobTypes RELOAD, RELOAD_ALL, FORCE_COMMIT goes to the same Znode. This increases write load on that Znode., especially given updates for all tables for the listed jobTypes goes to that Znode. We discovered the problem while implementing [rebalanceStatus](https://github.com/apache/pinot/pull/10359) and decided to create a separate Znode for TABLE_REBALANCE. This PR is to finish the clean up to move the other types to their separate Znodes. **Solution** : Move updates for for jobTypes RELOAD, RELOAD_ALL, FORCE_COMMIT, to their own Znodes. Combined RELOAD, RELOAD_ALL updates into a single Znode as they are related. **Note**: This is a backwards incompatible change. The status of previously completed reload jobs, will not be available after this change is deployed (1 days worth of reload/force_commit jobs ?). Given the low impact and to keep the code changes simple, we made this backwards incompatible. TODO: Clean up old reload/force_commit state when the controller boots up. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
