npawar opened a new pull request #3644: Split ValidationManager duties into 
separate ControllerPeriodicTasks
URL: https://github.com/apache/incubator-pinot/pull/3644
 
 
   As discussed in issue https://github.com/apache/incubator-pinot/issues/3642 
we want to be able to run realtime part of the validation manager much faster 
than all the other activities  in validation manager. 
   Splitting all the tasks of the ValidationManager into separate 
ControllerPeriodicTasks, so that we can better control the frequency of each 
one:
   1) OfflineSegmentIntervalChecker - to check for missing offline segments, 
can run daily by default
   2) RealtimeSegmentValidationManager - to fix partitions which have stopped 
consuming, can run hourly by default. Can be configured at the controller level 
to match realtime SLA of the cluster
   3) BrokerResourceValidationManager - to update broker on instance set changes

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to