npawar opened a new pull request #3668: Split validation manager tasks into separate periodic tasks URL: https://github.com/apache/incubator-pinot/pull/3668 Moving over from https://github.com/apache/incubator-pinot/pull/3644 As discussed in issue #3642 we want to be able to run realtime part of the validation manager much faster than all the other activities in validation manager. Splitting all the tasks of the ValidationManager into separate ControllerPeriodicTasks, so that we can better control the frequency of each one: OfflineSegmentIntervalChecker - to check for missing offline segments, can run daily by default RealtimeSegmentValidationManager - to fix partitions which have stopped consuming, can run hourly by default. Can be configured at the controller level to match realtime SLA of the cluster BrokerResourceValidationManager - to update broker on instance set changes
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
