mcvsubbu commented on PR #8911: URL: https://github.com/apache/pinot/pull/8911#issuecomment-1165754151
> +1 on maintaining the freshness lag for each table at ingestion time, which is independent of the segments queried. We might also consider maintaining it for each partition There are two things here: - Consumption lag (I think this is what you are referring to when you +1). https://github.com/apache/pinot/issues/5948. This changes each time we consume an event or if an event is produced to the stream. - Freshness (or Staleness) lag: This is answers the question : "How old is the newest data we considered while answering a query?" This is computed each time a query is answered. It is this second one that we are trying to address here. The first one is still open: https://github.com/apache/pinot/issues/5948 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
