J-HowHuang opened a new pull request, #18492:
URL: https://github.com/apache/pinot/pull/18492

   ## Description
   Depends on use cases, server starter might need to pause ingestion during 
start up for a better performance.
   
   ## Changes
   
   ### New boolean supplier for ingestion readiness
   Add a new boolean supplier `boolean isIngestionPausedDueToStartUp()` in 
`BaseServerStarter` that will be hooked into `TableDataManagerProvider` to 
construct `RealtimeTableDataManager`. This new boolean supplier, and the 
existing boolean supplier in `RealtimeTableDataManager` that signals whether 
it's ready to ingest on dedup or paritial upsert table,  they together will 
determine if the ingestion loop should start in `RealtimeSegmentDataManager`
   
   ### Add metrics to track time-to-ready for individual server start up status 
checks
   * `STARTUP_CURRENT_STATE_MATCH_TIME_MS`
   * `STARTUP_EXTERNAL_VIEW_MATCH_TIME_MS`
   * `STARTUP_REALTIME_CONSUMPTION_CATCHUP_TIME_MS`
   These gauge will show the time spent on individual phase of the server start 
up service status checks.
   
   They are tracked by a new class `TimeToHealthyTrackingCallback`, which is a 
wrapper around the original `ServiceStatusCallback` that track the time and 
emit the metrics.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to