9aman commented on PR #19161:
URL: https://github.com/apache/pinot/pull/19161#issuecomment-5239396507
If we want to decouple these calls from the above parameters maybe we can do
the following:
1. Fetch which offset will surely be valid 5 minutes from the call being
made ie. at `T + 5 minutes. `
2. Use this value for all the calls for the next 5 minutes i.e. cache the
above value and use it for comparison
- startOffset should be `>=` offset surely valid at T+5 minutes.
3. If this is false, then make an **actual call** otherwise refresh this at
the end of time T + 5.
This way we make a call every 5 minutes or k minutes instead of relying on
the batch size etc.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
