navina opened a new pull request, #9977:
URL: https://github.com/apache/pinot/pull/9977
This PR introduces a way to produce partition lag metrics for the supported
low level realtime consumers. Major changes include:
* Changed signature of
`RealtimeSegmentDataManager#getConsumerPartitionState` to include a boolean
`skipOffsetLag`. **Reasoning**:
- `fetchUpstreamLatest` involves making a call to the datasource. If
invoked frequently, it can overwhelm the data source broker.
- Debug APIs should still be able to fetch the latest upstream offset.
This is useful during debugging.
* New method in `RealtimeSegmentDataManager#handleConsumptionStatus` - This
is used to signal the segment data manager from external components like status
checker". For now, it will be used to signal whether the realtime consumer
segment has "caught up" per its consumption based status checker.
**Labels**: `observability` , `feature`, `release-notes`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
